Waiting on 1/1 pollers.

Post support questions that directly relate to Linux/Unix operating systems.

Moderators: Moderators, Developers

Author
Message
User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

Waiting on 1/1 pollers.

#1 Post by thomasN » Wed Nov 17, 2004 5:13 am

After I started running cactid to a remote database I could see that the poller.php never ended.

11/17/2004 11:09:56 AM - POLLER: Poller[0] Maximum runtime of 296 seconds exceeded. Exiting.

However, the actual polling is done a long time ago according to the log:

11/17/2004 11:05:54 AM - PHPSVR: Poller[0] DEBUG: PHP Script Server Shutdown request received, exiting
11/17/2004 11:05:54 AM - CACTID: Poller[0] Time: 53.2327 s, Threads: 5, Hosts: 136

When not redirecting output from poller.php to /dev/null I could see this:

Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.
Waiting on 1/1 pollers.

...

I ran a truss(1) on the php-process, output is attached.

Why doesn't cactid exit?
Attachments
truss.txt
Truss output
(18.91 KiB) Downloaded 323 times

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#2 Post by TheWitness » Wed Nov 17, 2004 6:15 am

What version of Cacti, what version of Cactid?
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#3 Post by thomasN » Wed Nov 17, 2004 10:57 am

cacti 0.8.6b and cactid 0.8.6c. Both release-versions (not cvs).

User avatar
rony
Developer/Forum Admin
Posts: 6016
Joined: Mon Nov 17, 2003 6:35 pm
Location: Michigan, USA
Contact:

#4 Post by rony » Wed Nov 17, 2004 11:13 am

Is cacti 0.8.5b patched with all the patches from:

http://www.cacti.net/downloads/patches/0.8.6b/
[size=117][i][b]Tony Roman[/b][/i][/size]
[size=84][i]Experience is what causes a person to make new mistakes instead of old ones.[/i][/size]
[size=84][i]There are only 3 way to complete a project: Good, Fast or Cheap, pick two.[/i][/size]
[size=84][i]With age comes wisdom, what you choose to do with it determines whether or not you are wise.[/i][/size]

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#5 Post by TheWitness » Wed Nov 17, 2004 7:04 pm

What version of PHP are your running? Is it CLI or CGI.

Thanks,

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#6 Post by thomasN » Thu Nov 18, 2004 5:10 am

php4-4.3.9

cli or cgi? I have a /usr/local/bin/php binary if that's what you mean.

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#7 Post by TheWitness » Thu Nov 18, 2004 5:11 am

Run "php -v" and post the results.

Larry
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#8 Post by TheWitness » Thu Nov 18, 2004 5:12 am

Run "php -v" and post the results.

Larry
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#9 Post by thomasN » Thu Nov 18, 2004 5:25 am

# php -v
PHP 4.3.9 (cli) (built: Oct 15 2004 11:54:56)
Copyright (c) 1997-2004 The PHP Group
Zend Engine v1.3.0, Copyright (c) 1998-2004 Zend Technologies

I also just noted that the rrd's are not beeing updated anymore. I switched back to running in the local database and now that doesn't work either. Yiikes..

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#10 Post by thomasN » Thu Nov 18, 2004 9:37 am

In the SQL-server, I can see this query beeing repeated for every time the Waiting for 1/1 poller message

041118 13:10:54 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)
041118 13:10:55 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)
041118 13:10:57 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)
041118 13:10:58 7 Query select poller_id,end_time from poller_time where poller_id = 0
7 Query select
poller_output.output,
poller_output.time,
poller_output.local_data_id,
poller_item.rrd_path,
poller_item.rrd_name,
poller_item.rrd_num
from poller_output,poller_item
where (poller_output.local_data_id=poller_item.local_data_id and poller_output.rrd_name=poller_item.rrd_name)

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#11 Post by thomasN » Thu Nov 18, 2004 9:42 am

rony wrote:Is cacti 0.8.5b patched with all the patches from:

http://www.cacti.net/downloads/patches/0.8.6b/
Now, yes, no change.

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#12 Post by TheWitness » Thu Nov 18, 2004 8:45 pm

Can you try running with cmd.php. Before you do so though, you need to truncate the poller_output table to prevent your system from overflowing.

So, first check the number of rows in poller_output, post it. Then truncate table poller_output. Then use cmd.php with say 8 concurrent processes to get your polling running again.

After that, let's talk updating cactid. We found yet another problem that may be causing your problems.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#13 Post by thomasN » Fri Nov 19, 2004 2:57 am

My poller_output has no data at all.

mysql> select * from poller_output;
Empty set (0.00 sec)

mysql> DESCRIBE poller_output;
+---------------+-----------------------+------+-----+---------------------+-------+
| Field | Type | Null | Key | Default | Extra |
+---------------+-----------------------+------+-----+---------------------+-------+
| local_data_id | mediumint(8) unsigned | | PRI | 0 | |
| rrd_name | varchar(19) | | PRI | | |
| time | datetime | | PRI | 0000-00-00 00:00:00 | |
| output | text | | | | |
+---------------+-----------------------+------+-----+---------------------+-------+
4 rows in set (0.00 sec)

So I guess no truncate will be neccecary?

User avatar
thomasN
Posts: 21
Joined: Tue Nov 16, 2004 3:29 pm

#14 Post by thomasN » Fri Nov 19, 2004 4:59 am

When running cmd.php the graphs are beeing updated but it doesn't even come close to getting through all objects (maximum execution time).

I modified MAX_POLLER_RUNTIME to a high value and let the script run. I can see rrds update and also mysql activity.

In the graphs now 'nan' is displayed. I can also confirm this with 'rrdtool fetch xxx.rrd AVERAGE'.

I tried switching back to cactid but same problem as before, I can see a loop if I run php thorugh truss and I can see the same queries on the mysql activity log.

Will try latest cactid from cvs later on today...

Edit: Can I run latest cactid? I remember reading about not beeing compatible with 0.8.6b but only with 0.8.7x.

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#15 Post by TheWitness » Fri Nov 19, 2004 5:00 pm

Thomas,

You will find attached a small change to cactid. Remake the file and see if it corrects your problem.

TheWitness
Attachments
cactid.c
(9.76 KiB) Downloaded 581 times
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

Post Reply