CACTID: Poller[0] ERROR: Problem with MySQL: Duplicate entry

TheWitness · Posted: Sun Apr 02, 2006 2:30 pm Post subject:

I received a PM from this user and the problem is due to a bogus data query that is attempting to store a data re-query for each OID of his data query.

I have sent a response to the user. This is not an issue with Cactid.

TheWitness

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

Can you take a quick look at the attached logs (3*segments) where I've replaced the Cactid versions.

When I look through, I see lots of mentions of Gigabit cards - using the standard scripts, so are these the ones you talk about ??

TheWitness · Posted: Mon Apr 03, 2006 7:24 am Post subject:

Hmm,

This is very interesting. Can you please send me a dump of your database. Send it via either pm or e-mail.

Thanks,

TheWitness

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

I've emailed the logs and dumps through.

I tried disabling "Foundry1", and then swapping out, but I still see the MySql errors. I included the non-debug sql log.

A

TheWitness · Posted: Mon Apr 03, 2006 8:23 pm Post subject:

It appears there is a bug with the "Verify All Fields" re-index method. If you can afford to, drop the data queries in question and then re-add them using the "Uptime Goes backward" until I make a patch. Your existing graphs will not be affected.

TheWitness

TheWitness · Posted: Mon Apr 03, 2006 10:05 pm Post subject:

Please try this version of Cactid, made from latest cygwin. The warning messages should not have affected anything since they were just confirming the "Verify All Fields" reindex method.

I have made them go away any way and can provide further "speed" optimization for "Verify All Fields" method as well, but I did not do that tonight.

TheWitness

zsnyder · Joined: 26 Jan 2006 Posts: 35 Location: Seattle, WA

I downloaded the latest code from SVN and compiled it today. I'm not longer seeing the Duplicate Entry messages at all. And I'm able to query all my hosts in a fraction of the time it was taking--the whole point behind running Cactid in the first place!

Thanks for all your help with this!

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

That posted cactid did some very "bad" things to my system. Using Process Explorer it looked like it just started up but hung, then timed out after >200 seconds. I've switched back to the original g version.

TheWitness · Posted: Sun Apr 09, 2006 12:31 pm Post subject:

I would like to know why. Between polls, can you test from the command line with something like "cactid.exe 1 20" and let me know what the output looks like?

TheWitness

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

Ok... I'll have to leave it to Tue/Wed I think, but I'll see what I can do. Can you tell me which version of cygwin you have ? I upgraded today to try and match.

TheWitness · Posted: Sun Apr 09, 2006 10:13 pm Post subject:

yes, i built with the latest. that might explain it.

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

Ok... here we go..

First I got an error about not having cygcrypto-0.9.8.dll in the path...
So I installed openssl from cygwin, and then I added c:\cygwin\bin to the system PATH...

Now I get :

No log handling enabled - turning on stderr logging
Cannot find module (NOTIFICATION-LOG-MIB): At line 1 in (none)
Cannot find module (NET-SNMP-AGENT-MIB): At line 1 in (none)
Cannot find module (NET-SNMP-EXTEND-MIB): At line 1 in (none)
CACTID: Using cactid config file [cactid.conf]
CACTID: Version 0.8.6g starting

So I'll try replacing the main .exe again...

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

Looks happier now. But still takes a long time to run now:

04/12/2006 05:25:54 PM - SYSTEM STATS: Time:52.5079 Method:cactid Processes:2 Threads:1 Hosts:46 HostsPerProcess:23 DataSources:2540 RRDsProcessed:1730

Used to take about 30-40s before (for about 2300 datasources)...

I'm rebooting the box to see if the PATH update needs to take effect.

TheWitness · Posted: Thu Apr 13, 2006 5:15 am Post subject:

Those error messages have to do with missing MIB modules and should not affect polling. You should replace those mibs though.

TheWitness

adrianmarsh · Cacti User Joined: 17 Aug 2005 Posts: 417 Location: UK

Ok... so.. my original times for cactid to run were 30-35s... After the upgrade this moved up to 50-60s, although I have added some more DS's along the way.

After I installed net-snmp again, and added the MIBs - now those warnings go away..but the avg time is 60-65s.

So I started looking at the threads. Original settings were: 2 pollers, 1 thread each, 1 server, SNMP -Reliable timeout only.

I tried changing this to 1 poller, 1 server, 2 threads, SNMP+ping, but then I started getting errors.

Cleared the polling cache....

I think I've isolated the problem... When I use Ping+snmp (most recommended), then I get this fault. When I only use snmp, I don't