[rancid] F5 Rancid | BIGIP 12.0 | missed cmd(s)

[Alan McKinnon]

Shaun,

Usually setting PATH correctly is enough, but I don't think that is your 
problem. To check that I understand the problem correctly:

All your devices work correctly except BIGIP 12. Even BIGIP 11 works 
properly. BIGIP 12 fails from a cronjob but works correctly from the 
command line as rancid user. This then excludes mistakes in router.db

Correct?

Nothing in cron or the environment strikes me as being unique to the 
BIGIP 12. For completeness, what is in the rancid user's environment in 
a regular login shell?

If that doesn't reveal anything useful, I'd generate .raw files for both 
device types and compare them. Then read those files directly into 
rancid; at some point a difference in behaviour must show up

On 12/09/2016 10:24, Shaun Krok wrote:
> Thanks Alan
>
> Always have been running as *user* = rancid
> [rancid at Rancid bin]$ whoami
> Rancid
>
> # Check every 30 mins
> */30 * * * * /usr/local/rancid/bin/rancid-run &
>
> What do you suggest with regards setting up the cron environment for rancid --- never had to prior BIGIP 12.0 and all other device types: Cisco, Juniper, Riverbed , F5 working 100%
>
>
>
> -----Original Message-----
> From: Rancid-discuss [mailto:rancid-discuss-bounces at shrubbery.net] On Behalf Of Alan McKinnon
> Sent: Monday, September 12, 2016 11:15 AM
> To: rancid-discuss at shrubbery.net
> Subject: Re: [rancid] F5 Rancid | BIGIP 12.0 | missed cmd(s)
>
> This problem almost always comes down to the usual issues with cron:
>
> - cron runs from a non-interactive non-login shell, meaning that the
> environment is empty (the environment being nothing more than a handy
> *user* convenience). Make sure your cron env is set up correctly and
> don't run ./rancid-run, specify the full correct path
>
> - which user's cron is this in? It must go in rancid's crontab, not
> root. If this is the case with your site, make sure you chown all
> relevant data files back to the rancid user as some of them will now be
> owned by root
>
>
> On 12/09/2016 09:17, Shaun Krok wrote:
>> Hi
>>
>> I have tried to look into  forums where other users of rancid experience the same issue but could not find anything !
>>
>> Our issue as follows :
>> We have been running rancid successfully against F5 LTM clusters (HA) for a few years now.
>> The issue with partitions and TMSH was resolved and we have had no issues accept with the recent upgrade to BIGIP image : BIG-IP 12.0.0
>>
>> The issue is below.
>> What we have noticed that if we use the cli command : ./rancid-run -r lon-f5-pri GLN & the collection has no issues, diff is done, entered into CVS and emails received !
>>
>> The problem is when the general cron runs and we receive the below in the logs.
>> Using the NOPIPE I see the .raw file and have looked into the file and do not see any issues.
>>
>> The f5rancid script has been working as I said for years until version 12.0 of BIGIP.
>> It works against several other production sites but running version 11.6 of BIGIP
>>
>> I realize the below is just the process saying there is an issue but if anyone has suggestions would be much appreciated !
>>
>> Version of rancid : ## rancid 3.2.99
>>
>> ***************************************
>> a snip of the crontab
>> # Check every 30 mins
>> */30 * * * * /usr/local/rancid/bin/rancid-run &
>> **************************************
>>
>> **************************************
>> A snip of the f5rancid script
>> # tmsh commands, BIGIP v11
>> @tmsh_commandtable = (
>> {'tmsh show /sys version' => 'ShowVersion'},
>> {'tmsh show /sys hardware' => 'ShowHardware'},
>> {'tmsh show /sys license' => 'ShowLicense'},
>> #{'cat /config/ZebOS.conf' => 'ShowZebOSconf'},
>> #{'lsof -i :179' => 'ShowZebOSsockets'},
>> {'tmsh show /net route static' => 'ShowRouteStatic'},
>> #{'ls --full-time --color=never /config/ssl/ssl.crt' => 'ShowSslCrt'},
>> #{'ls --full-time --color=never /config/ssl/ssl.key' => 'ShowSslKey'},
>> #{'tmsh -q list' => 'WriteTermTMSH'},
>> #{'tmsh -q -c /"cd /;list recursive"/' => 'WriteTermTMSH'},
>> {'./f5part' => 'WriteTermTMSH'},
>> **************************************
>>
>>
>> Trying to get all of the configs.
>> lon-f5-pri: missed cmd(s): tmsh show /net route static,tmsh show /sys hardware
>> lon-f5-sec: missed cmd(s): tmsh show /net route static,tmsh show /sys version,tmsh show /sys hardware,tmsh show /sys license
>> =====================================
>> Getting missed routers: round 1.
>> lon-f5-sec: missed cmd(s): tmsh show /net route static,tmsh show /sys version,tmsh show /sys hardware,tmsh show /sys license
>> lon-f5-pri: missed cmd(s): tmsh show /net route static,tmsh show /sys hardware
>> =====================================
>> Getting missed routers: round 2.
>> lon-f5-sec: missed cmd(s): tmsh show /net route static,tmsh show /sys version,tmsh show /sys hardware,tmsh show /sys license
>> lon-f5-pri: missed cmd(s): tmsh show /net route static,tmsh show /sys hardware
>> =====================================
>> Getting missed routers: round 3.
>> lon-f5-pri: missed cmd(s): tmsh show /net route static,tmsh show /sys hardware
>> lon-f5-sec: missed cmd(s): tmsh show /net route static,tmsh show /sys version,tmsh show /sys hardware,tmsh show /sys license
>> =====================================
>> Getting missed routers: round 4.
>> lon-f5-sec: missed cmd(s): tmsh show /net route static,tmsh show /sys version,tmsh show /sys hardware,tmsh show /sys license
>> lon-f5-pri: missed cmd(s): tmsh show /net route static,tmsh show /sys hardware
>>
>>
>> regards
>>
>>
>>
>> Shaun Krok
>> Network Team
>>
>> Herzliya Business Park
>> Herzliya Pituach 46140
>> Israel
>>
>> Telephone: +972 (0)732889406
>> Mobile: +972 (0)50 2424381
>> email:shaun.krok at 888holdings.com
>>
>>
>>
>>
>>
>>
>>
>> This email message and its attachments are for the sole use of the intended recipient(s) and may not be shared with any other party. They may contain confidential information of 888 Holdings plc or its direct and indirect subsidiaries (together, the “888 Group”) and are to be regarded as confidential information under any non-disclosure agreement. Any review, use, disclosure or distribution by persons or entities other than the intended recipient(s) is prohibited. Nothing in this message is capable of or intended to create any legally binding obligation. The 888 Group will only ever assume a legally binding obligation where recorded in a written agreement duly executed by the authorized signatories of the relevant 888 Group company. The 888 Group accepts no liability for any personal views expressed in this message. If you are not the intended recipient, please contact the sender by return and destroy all copies of the original message and its attachments. Thank you
>> _______________________________________________
>> Rancid-discuss mailing list
>> Rancid-discuss at shrubbery.net
>> http://www.shrubbery.net/mailman/listinfo/rancid-discuss
>>
>
> _______________________________________________
> Rancid-discuss mailing list
> Rancid-discuss at shrubbery.net
> http://www.shrubbery.net/mailman/listinfo/rancid-discuss
>
>
> This email message and its attachments are for the sole use of the intended recipient(s) and may not be shared with any other party. They may contain confidential information of 888 Holdings plc or its direct and indirect subsidiaries (together, the “888 Group”) and are to be regarded as confidential information under any non-disclosure agreement. Any review, use, disclosure or distribution by persons or entities other than the intended recipient(s) is prohibited. Nothing in this message is capable of or intended to create any legally binding obligation. The 888 Group will only ever assume a legally binding obligation where recorded in a written agreement duly executed by the authorized signatories of the relevant 888 Group company. The 888 Group accepts no liability for any personal views expressed in this message. If you are not the intended recipient, please contact the sender by return and destroy all copies of the original message and its attachments. Thank you
>