Cacti (home)ForumsDocumentation
Cacti: offical forums and support
It is currently Fri Apr 28, 2017 12:56 pm

All times are UTC - 5 hours




Post new topic Reply to topic  [ 31 posts ]  Go to page Previous  1, 2, 3  Next
Author Message
 Post subject:
PostPosted: Fri Nov 07, 2008 9:46 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
Here we go..
Attached is the spine output (with poller_943.c).


Attachments:
File comment: spine output.
081107-spine-log_943.zip [133.8 KiB]
Downloaded 341 times
Top
 Profile  
 
 Post subject:
PostPosted: Fri Nov 07, 2008 4:17 pm 
Offline
Developer
User avatar

Joined: Tue May 14, 2002 5:08 pm
Posts: 14863
Location: MI, USA
Ok, well that tell's me a few things. I am wondering about the scripts now. It looks like there may be some out of band data getting in on them. I am making a few more changes to poller.c. Will attach momentarily.

TheWitness

_________________
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
Gandalfs Official Debugging Help
Central Plugin Repository
Central Templates Repository


Top
 Profile  
 
 Post subject:
PostPosted: Fri Nov 07, 2008 4:21 pm 
Offline
Developer
User avatar

Joined: Tue May 14, 2002 5:08 pm
Posts: 14863
Location: MI, USA
Try this version. Send the log again.

TheWitness


Attachments:
poller.c [46.45 KiB]
Downloaded 356 times

_________________
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
Gandalfs Official Debugging Help
Central Plugin Repository
Central Templates Repository
Top
 Profile  
 
 Post subject:
PostPosted: Mon Nov 10, 2008 5:02 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
G'day!

Somehow it fails now before/while running the first 'Script/Command'.
Please see attached output.

GDB says:
Code:
(gdb) b *0x407a1c
Breakpoint 1 at 0x407a1c: file poller.c, line 848.
(gdb) b *0x4099b3
Breakpoint 2 at 0x4099b3: file poller.c, line 53.


Cheers!


Attachments:
File comment: ./spine --verbosity=5 -R
081110-spine-log_415.txt [15.01 KiB]
Downloaded 376 times
Top
 Profile  
 
 Post subject:
PostPosted: Mon Nov 10, 2008 7:37 am 
Offline
Developer
User avatar

Joined: Tue May 14, 2002 5:08 pm
Posts: 14863
Location: MI, USA
Well, that's odd. Comment out line 848 and try again.

TheWitness

_________________
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
Gandalfs Official Debugging Help
Central Plugin Repository
Central Templates Repository


Top
 Profile  
 
 Post subject:
PostPosted: Mon Nov 10, 2008 9:18 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
Hmm.. Strange.. Now it get's even more complicated..

Line 846 has been commented out... That's where you're freeing 'poll_result'... --> 'free(poll_result);'...
Line 848 is only 'SPINE_LOG_MEDIUM...' and I leave it therefore untouched...

After doing that, spine hangs on the very first poller item.
This item is a normal 'Script/Command'.
Code:
11/10/2008 02:21:33 PM - SPINE: Poller[0] Host[0] DEBUG: The POPEN returned the following File Descriptor 6
11/10/2008 02:21:33 PM - SPINE: Poller[0] Host[0] DS[9460] SCRIPT: php /var/www/html/cacti/scripts/kpi_query.php, output: online:534 offline:16
11/10/2008 02:21:33 PM - SPINE: Poller[0] DEBUG: SQL:'INSERT INTO poller_output (local_data_id, rrd_name, time, output) VALUES (9460,'','2008-11-10 14:21:33','online:534 offline:16')'

Interesting fact is, that the rrd file name seems to be missing in the 'insert' sql statement.

I gave it another try after 'disabling' this particular data source and then it stopped on the next 'Script/Command' with more then 1 return value!
Means, that the 'ping.pl' script which only returns something like output: 24.7 runs fine, but another script with the following return values output: online:534 offline:16 makes spine hang...

Disabling all of these 'multi return value' scripts makes spine to run fine for about 5 seconds and then it ceases to poll any further... Hanging again without error message... (This output has been attached to this post.)

Hope I'm not confusing you too much... :-)


Attachments:
File comment: - spine log without line 846 in poller.c
- disabled 'Script/Commands' with more then one return value.

081110-spine-log_415-wo-l-846.txt [322.77 KiB]
Downloaded 337 times
Top
 Profile  
 
 Post subject:
PostPosted: Tue Nov 11, 2008 6:40 am 
Offline
Developer
User avatar

Joined: Tue May 14, 2002 5:08 pm
Posts: 14863
Location: MI, USA
I actually wanted you to comment out the SPINE_LOG. Can you do that and provide feedback. Line 848.

TheWitness

_________________
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
Gandalfs Official Debugging Help
Central Plugin Repository
Central Templates Repository


Top
 Profile  
 
 Post subject:
PostPosted: Tue Nov 11, 2008 9:51 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
Hi!

Ok. I've removed line 848.
Attached you'll find two logs. One is a spine run with active 'Script/Commands' and the other one is with disabled 'Script/Commands'.

GDB says the following about the run with active Script/Commands.
Code:
(gdb) b *0x407a19
Breakpoint 1 at 0x407a19: file poller.c, line 852.
(gdb) b *0x409973
Breakpoint 2 at 0x409973: file poller.c, line 53.


And the following about the run without Script/Commands.
Code:
(gdb) b *0x408248
Breakpoint 1 at 0x408248: file poller.c, line 1002.
(gdb) b *0x409973
Breakpoint 2 at 0x409973: file poller.c, line 53.


Cheers!


Attachments:
File comment: Log with enabled 'Script/Commands'
081111-spine-log-incl-script-commands.txt [108.12 KiB]
Downloaded 351 times
File comment: Log with disabled 'Script/Commands'
081111-spine-log-excl-script-commands.txt [1.33 MiB]
Downloaded 340 times
Top
 Profile  
 
 Post subject:
PostPosted: Tue Nov 11, 2008 3:43 pm 
Offline
Developer
User avatar

Joined: Tue May 14, 2002 5:08 pm
Posts: 14863
Location: MI, USA
Ok, here is another poller.c. Now this time, please disable any hosts that you need to perform a gethostbyname on in other words, use only for hosts that are stored using their IP Address.

TheWitness


Attachments:
poller.c [46.53 KiB]
Downloaded 363 times

_________________
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
Gandalfs Official Debugging Help
Central Plugin Repository
Central Templates Repository
Top
 Profile  
 
 Post subject:
PostPosted: Wed Nov 12, 2008 8:42 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
We always store devices with their IP address in Cacti. No look-up is being made.

I had to run spine again without any Script/Commands. Log output is attached.

Cheers!


Attachments:
File comment: ./spine --verbosity=5 -R
- No Script/Commands

081112-spine-without-script-commands.txt [1.33 MiB]
Downloaded 365 times


Last edited by tobus on Wed Nov 12, 2008 9:10 am, edited 2 times in total.
Top
 Profile  
 
 Post subject:
PostPosted: Wed Nov 12, 2008 8:47 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
BTW, GDB said:
Code:
(gdb) b *0x408268
Breakpoint 1 at 0x408268: file poller.c, line 1002.


Top
 Profile  
 
 Post subject:
PostPosted: Wed Nov 12, 2008 9:30 am 
Offline
Developer
User avatar

Joined: Tue May 14, 2002 5:08 pm
Posts: 14863
Location: MI, USA
One other thing, does this happen at logging level LOW?

TheWitness

_________________
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
Gandalfs Official Debugging Help
Central Plugin Repository
Central Templates Repository


Top
 Profile  
 
 Post subject:
PostPosted: Wed Nov 12, 2008 9:58 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
./spine --verbosity=2 -R

gives me that:

Code:
Breakpoint 2 at 0x408268: file poller.c, line 1002.
(gdb) b *0x4099c3
Breakpoint 3 at 0x4099c3: file poller.c, line 53.
(gdb)


Same for all other --verbosity levels. (Also if not using the --verbosity option.)


Top
 Profile  
 
 Post subject: spine
PostPosted: Tue Nov 18, 2008 10:28 am 
Offline
Cacti User

Joined: Thu May 17, 2007 9:18 am
Posts: 233
is this issue resolved? if yes, do you have the windows binary of spine?


Top
 Profile  
 
 Post subject:
PostPosted: Tue Nov 18, 2008 10:37 am 
Offline
User avatar

Joined: Mon Jan 30, 2006 11:47 am
Posts: 33
Location: Zurich, Switzerland
Hi there!

Not yet solved for me. I have plans to set-up another test machine some when soon to give it another try.
But I don't think, that the windows binary will give you the same problem, if there is any?...

Cheers!


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 31 posts ]  Go to page Previous  1, 2, 3  Next

All times are UTC - 5 hours


Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  

Protected by Anti-Spam ACP Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group