Cactid processes climbing and gaps in graphs

Post support questions that relate to the Windows 2003/2000/XP operating systems.

Moderators: Moderators, Developers

Author
Message
User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

Cactid processes climbing and gaps in graphs

#1 Post by lard » Mon Nov 28, 2005 8:04 am

Hello,

I have an issue on a cacti server with Cactid (version f) where I will see approx 20/30 instances of cactid.exe running on the server without dissappearing.

I am also showing gaps in multiple graphs at varying intervals but at the same time on all devices,

Is their any logging I can enable for Cactid to look into this problem??

Thanks,

Larry
---- lard007skype ----

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#2 Post by lard » Mon Nov 28, 2005 8:06 am

Sorry- Versions:

Cactid 0.8.6f
Cacti 0.8.6g
Windows 2000

Thanks,

Larry
---- lard007skype ----

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#3 Post by lard » Mon Nov 28, 2005 8:14 am

Just to add - the gaps in the graphs I have a feeling are network related - it's more the processes that is concerning me?

Any info needed then let me know,

Thanks,

Larry
---- lard007skype ----

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#4 Post by lard » Mon Nov 28, 2005 8:19 am

The following error is appearing quite often in the cacti log file:

11/28/2005 12:03:07 PM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating


Any one had any experience of this one?

Thanks,

Larry
---- lard007skype ----

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#5 Post by lard » Mon Nov 28, 2005 8:24 am

Attachment shows the processes on the desktop of the server - as expected these are all listed as "cactiplus"

Thinking on this...their is a way to stop processes interacting with the desktop on windows - may help!

Thanks,

Larry
Attachments
cactip.jpg
Desktop shot of hung processes
cactip.jpg (143.81 KiB) Viewed 10306 times
---- lard007skype ----

wvr120364
Posts: 16
Joined: Tue May 06, 2003 7:48 am

#6 Post by wvr120364 » Tue Nov 29, 2005 2:57 am

Larry,

I have the same with cacti 8.6g with the php-poller running. I tried to set a maximum time for scheduled task, but that was no help. The only way for me was to kill all cmd processes by hand.

A question, did you have mbm5 installed? When I stop polling mbm5 it all looks good.

Wietze

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#7 Post by lard » Tue Nov 29, 2005 4:54 am

Hello,

Just had a google to see what mbm5 was :)

But no - I don't use mbm5 for polling but I am wondering about the phpserver error I am getting in the log files - could it be that your mbm5 monitoring was via a php script that was faulty? - If this is the case then it would make sense that we both have an issue and this is down to scripts,

One change I made was to increase the timeout within php.ini to get data from some slow responding cisco switches - is this something you changed?

Thanks,

Larry
---- lard007skype ----

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#8 Post by TheWitness » Tue Nov 29, 2005 6:10 am

lard,

It is likely the PHP server error that is causing your issues. Please post your cygwin version installed (if at all).

When the PHP Script Server issues an Input Expected, Script Server Terminating, it is due to a Cactid segfault. Not a good thing. That version of Cactid has been pretty stable. I have a newer version of Cactid out on the web site that may provide happieness. However, before you go there, I would like some information:

PHP Version?
CGI or CLI?
Windows Version?
Cygwin1.dll Version?
Net-SNMP Version?
Did you Make Cactid or Download?
Are you using the Script Server. You can tell by Running Cactid in DEBUG for 1 pass and posting the DEBUG log.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
BSOD2600
Cacti Moderator
Posts: 12160
Joined: Sat May 08, 2004 12:44 pm
Location: USA

#9 Post by BSOD2600 » Tue Nov 29, 2005 11:30 am

Isn't cactiplus used for exporting?

Do you have exporting enabled in cacti?

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#10 Post by lard » Tue Nov 29, 2005 12:55 pm

Hello Guys,

In response to the cactiplus query - Graph export is currently set to disabled,

The versions requested are as follows:

PHP version 5.0.4
Not too sure what you mean by CGI or CLI? :-?
Windows 200 Server SP4
I installed complete cygwin app - version 2.510.2.2 if this helps
Net-SNMP version 5.2.1-1
I downloaded the cactid pre-compiled

Any more info needed then let me know - finally the debug log is as below - this is only a section of it as when it made one pass under DEBUG the log was pver 2Mb - if you need the entire thing then let me know - I have included the starting section and also a section that shows the error

Many thanks,

Lard


11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: SQLCMD: update host set status='3',status_event_count='0', status_fail_date='2005-11-29 12:03:00',status_rec_date='0000-00-00 00:00:00',status_last_error='Host did not respond to SNMP',min_time='0.000000',max_time='999.999990',cur_time='0.999930',avg_time='13.852200',total_polls='30651',failed_polls='37',availability='99.8793' where id='3'
11/29/2005 05:46:59 PM - CACTID: Poller[0] Host[3] SNMP Result: Host responded to SNMP
11/29/2005 05:46:59 PM - CACTID: Poller[0] MYSQL: Connected to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: The Value of Active Threads is 2
11/29/2005 05:46:59 PM - CACTID: Poller[0] MYSQL: Connecting to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: Valid Thread to be Created
11/29/2005 05:46:59 PM - CACTID: Poller[0] DEBUG: In Poller, About to Start Polling of Host
11/29/2005 05:46:58 PM - CACTID: Poller[0] Host[0] DEBUG: HOST COMPLETE: About to Exit Host Polling Thread Function
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connected to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The Value of Active Threads is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connecting to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Valid Thread to be Created
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: In Poller, About to Start Polling of Host
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Initial Value of Active Threads is 0
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Parent pid=9368, Script Server pid=4180
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server Child FORK Success
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: Confirmed PHP Script Server Running.
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] PHP Script Server has Started - Parent is cactid
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: FILENM: e:\Apache2\htdocs\cacti\script_server.php
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: DIRNAM: e:/apache2/htdocs/cacti
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: GETCWD: e:/cactid
11/29/2005 05:46:58 PM - PHPSVR: Poller[0] DEBUG: SERVER: cactid
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server Child FORK Success
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server About to FORK Child Process
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: PHP Script Server Routine Starting
11/29/2005 05:46:58 PM - CACTID: Poller[0] CACTID: Initializing PHP Script Server
11/29/2005 05:46:58 PM - CACTID: Poller[0] CACTID: Initializing Net-SNMP API
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connected to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] MYSQL: Connecting to MySQL database 'cacti' on '127.0.0.1'...
11/29/2005 05:46:58 PM - CACTID: Poller[0] CACTID: Version 0.8.6f starting
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The Maximum SNMP OID Get Size is 10
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The PHP Script Server is Required
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: StartHost='0', EndHost='212', TotalPHPScripts='21'
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The script timeout is 25
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The number of concurrent processes is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The polling interval is the system default
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The threads variable is 10
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_pstats variable is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_pwarn variable is 0
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_perror variable is 0
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_timeout variable is 400
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_retries variable is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_method variable is 1
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_failure_count variable is 2
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The ping_recovery_count variable is 3
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The availability_method variable is 2
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The path_php variable is e:/php/php-win.exe
11/29/2005 05:46:58 PM - CACTID: Poller[0] DEBUG: The log_destination variable is 1
11/29/2005 05:46:58 PM - POLLER: Poller[0] DEBUG: About to Spawn a Remote Process [CMD: e:\cactid\cactid.exe, ARGS: 0 212]


And error:

1133286418:73373153
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_sysuptime_212.rrd --template sysUpTime 1133286418:69893930
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_traffic_in_213.rrd --template traffic_in:traffic_out 1133286418:897752096:414315242
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_traffic_in_214.rrd --template traffic_in:traffic_out 1133286418:351033370:827244799
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_traffic_in_215.rrd --template traffic_in:traffic_out 1133286418:0:0
11/29/2005 05:47:04 PM - POLLER: Poller[0] CACTI2RRD: E:\rrdtool/rrdtool.exe update E:\Apache2\htdocs\cacti\rra\roleeds01_5min_cpu_211.rrd --template 5min_cpu 1133286418:5
11/29/2005 05:47:06 PM - PHPSVR: Poller[0] ERROR: Input Expected, Script Server Terminating
11/29/2005 05:47:06 PM - SYSTEM STATS: Time:8.7452 Method:cactid Processes:1 Threads:10 Hosts:168 HostsPerProcess:168 DataSources:6512 RRDsProcessed:219
11/29/2005
---- lard007skype ----

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#11 Post by lard » Wed Nov 30, 2005 6:17 am

BSOD2600 wrote:Isn't cactiplus used for exporting?

Do you have exporting enabled in cacti?
Hello,

Just checked on our other Cacti server and it also launches two DOS prompts when Cacti polls - one called "cactiplus" and the other is cmd.exe,

This only happened since the new version was installed but is the same on both servers - before it would just launch two cmd.exe's

Thanks,

Lard
---- lard007skype ----

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#12 Post by TheWitness » Wed Nov 30, 2005 6:23 am

Cactiplus is the name for all poller driven started tasks. The dos command is a nasty side effect because of Windows. It needs a operating environment and that is initialized by a cmd.exe. This is all normal whether it's a cmd.php, part of cactid, poller reindexing, poller_command, or poller_export.

Please see my post under announcements. I want people to test this new version.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

User avatar
lard
Cacti User
Posts: 165
Joined: Wed Jul 20, 2005 10:48 am
Location: UK - Cambridge

#13 Post by lard » Wed Nov 30, 2005 8:06 am

Hi Witness,

If you have a new version out then it makes sense to can this post and re-visit if it is still a problem in the later version of cactid,

As mentioned - only one of our two cacti servers is having this issue so I am not certain that I could recreate my problem cacti server on a test platform and try the beta cactid - if I manage to recreate it I'll put on the Beta Cactid - failing that I'll wait for it to go mainstream and upgrade to cure this problem!

Thanks for looking into this,

Lard
---- lard007skype ----

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

#14 Post by gandalf » Wed Nov 30, 2005 3:38 pm

Moved to Win32 Specific
Reinhard

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#15 Post by TheWitness » Wed Nov 30, 2005 9:03 pm

What is likely happening is that your php script server scripts are hanging. What script server scripts do you currently run?

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

Post Reply