Submit Your CMD.PHP vs. CACTID Metrics Here

TheWitness · Posted: Tue Jul 24, 2007 6:37 pm Post subject:

Lol. Definately.

Larry

frdrk · Joined: 06 Jul 2007 Posts: 41

Omg.. cactid rocks man

08/03/2007 09:45:16 AM - SYSTEM STATS: Time:14.2933 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:40:15 AM - SYSTEM STATS: Time:14.5393 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:35:15 AM - SYSTEM STATS: Time:14.3520 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:30:16 AM - SYSTEM STATS: Time:14.2550 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 09:25:16 AM - SYSTEM STATS: Time:14.3465 Method:cactid Processes:10 Threads:10 Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846

08/03/2007 08:47:51 AM - SYSTEM STATS: Time:170.4112 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:3491
08/03/2007 08:43:01 AM - SYSTEM STATS: Time:179.9425 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 08:38:16 AM - SYSTEM STATS: Time:194.8529 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 08:33:03 AM - SYSTEM STATS: Time:182.5447 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846
08/03/2007 08:28:10 AM - SYSTEM STATS: Time:189.3863 Method:cmd.php Processes:10 Threads:N/A Hosts:54 HostsPerProcess:6 DataSources:4418 RRDsProcessed:1846

System is debian4 running on Xeon 3Ghz HT with 1Gb memory. Cacti 0.8.6j and cactid 0.8.6i. Since this server was already on its knees running nagios, rancid etc etc.. this would definitely speed things up

generic_user · Joined: 15 Jun 2007 Posts: 25

Can someone tell me when the new version of Cactid will be released on Windows Platform? Here are my current stats and I am stuck as far as increasing performance.

I was running with higher processes but getting errors from poller:
08/06/2007 01:21:24 PM - SYSTEM STATS: Time:84.0608 Method:cactid Processes:20 Threads:40 Hosts:903 HostsPerProcess:46 DataSources:17223 RRDsProcessed:0
08/06/2007 01:16:24 PM - SYSTEM STATS: Time:84.2241 Method:cactid Processes:20 Threads:40 Hosts:903 HostsPerProcess:46 DataSources:17223 RRDsProcessed:0

So i decided to search forums and after changing to recommended processes:
08/06/2007 01:32:26 PM - SYSTEM STATS: Time:145.6436 Method:cactid Processes:8 Threads:20 Hosts:903 HostsPerProcess:113 DataSources:17223 RRDsProcessed:0
08/06/2007 01:28:07 PM - SYSTEM BOOST STATS: Time:48.0393 RRDUpdates:50701
08/06/2007 01:27:19 PM - SYSTEM STATS: Time:139.4736 Method:cactid Processes:8 Threads:20 Hosts:903 HostsPerProcess:113 DataSources:17223 RRDsProcessed:0

I know faster polling speeds are possible but not sure what I am doing wrong. Here is my host info:
Cacti Version 0.8.6j
Plugin Architecture 1.1
Poller Type Cactid v0.8.6i
Server Info Windows NT 5.2
Web Server Microsoft-IIS/6.0
PHP Version 5.2.3
PHP Extensions bcmath, calendar, com_dotnet, ctype, session, filter, ftp, hash, iconv, json, odbc, pcre, Reflection, date, libxml, standard, tokenizer, zlib, SimpleXML, dom, SPL, wddx, xml, xmlreader, xmlwriter, ISAPI, ldap, mysql, snmp, sockets
MySQL Version 5.0.37-community-nt
RRDTool Version 1.2.15
SNMP Version snmpwalk [OPTIONS] AGENT [OID] Version: 5.4 Web:
Plugins Network Discovery (discovery - v0.7)
Syslog Monitoring (haloe - v0.4)
Host Info (hostinfo - v0.1)
Global Plugin Settings (settings - v0.1)
Large Site Performane Booster for Cacti (boost - v1.2)

gandalf · Posted: Mon Aug 06, 2007 2:17 pm Post subject:

You should verify memory settings. The memory size of the boost memory table should be taken for php.ini's memory settings as well (this was discussed lately). You should definately upgrade to latest boost.
And I'm quite sure, that latest rrdtool would be better (includes fadvise precedure to avoid disk cache being filled up with unnecessary rrdtool data). Perhaps, cactid from SVN will also introduce a performance boost. I did not keep up with the latest changes, but there has been improvement as well.
Then, disk performance is cruical and enough memory for MySQL would be appreciated. There have been bigger installations than your polling faster (depending on server sizing, of course), but this depends on data retrieval methods used: SNMP is the fastest method. Scripts are way slower.
Reinhard

TheWitness · Posted: Sat Aug 11, 2007 8:40 pm Post subject: Re: New version of Cactid release

ogou · Joined: 13 Feb 2006 Posts: 17 Location: Paris / France

Hi all ,

Here are my result :

08/13/2007 05:12:13 PM - SYSTEM STATS: Time:12.2505 Method:cactid Processes:2 Threads:20 Hosts:130 HostsPerProcess:65 DataSources:15766 RRDsProcessed:5982
08/13/2007 05:07:13 PM - THOLD: Poller[0] End Checking Thresholds
08/13/2007 05:07:13 PM - THOLD: Poller[0] Checking Thresholds
08/13/2007 05:07:13 PM - SYSTEM STATS: Time:12.1879 Method:cactid Processes:2 Threads:20 Hosts:130 HostsPerProcess:65 DataSources:15766 RRDsProcessed:5982
08/13/2007 05:02:14 PM - THOLD: Poller[0] End Checking Thresholds
08/13/2007 05:02:14 PM - THOLD: Poller[0] Checking Thresholds
08/13/2007 05:02:13 PM - SYSTEM STATS: Time:12.3054 Method:cactid Processes:2 Threads:20 Hosts:130 HostsPerProcess:65 DataSources:15766 RRDsProcessed:5982

Soft:
Cacti Version 0.8.6h
Cactid Version 0.8.6i
MySQL Version 5.0.37

Hard:
Dell PowerEdge BI-QuadCore Xeon 1.6Ghz
16 Go RAM
DD 146Go 15000RPM

OS : FedoraCore 7

And I'm using the 'temporary filesystem' (tmpfs) for all my RRD files !!!

Olivier

aleu · Cacti User Joined: 11 Dec 2006 Posts: 108

Guys,
What is your recommendation (#threads, etc) for the following environment:

2xIntel(R) Xeon(TM) CPU 3.00GHz
2GB RAM

The platform is used to run Cacti only.

Poller Item Stats:
SNMP 4000
Scripts 20
Script Server 600

SYSTEM STATS: Time:124.8688 Method:cactid Processes:4 Threads:40 Hosts:76 HostsPerProcess:19 DataSources:3604 RRDsProcessed:1925

I am planning to increase the number of hosts to 100.

What is your recommendation for:
Maximum Concurrent Poller Processes
Maximum Threads per Process
Number of PHP Script Servers
Script and Script Server Timeout Value
The Maximum SNMP OID's Per SNMP Get Request
?

They are currently set as 4, 40, 2, 25, 25 (in the above order).

The box runs heavily (load average: 59.02, 43.45, 35.15; Cpu(s): 59.1% us, 8.1% sy, 0.0% ni, 32.7% id, 0.0% wa) and some of the graphs do show gaps.

Thanks

TheWitness · Posted: Wed Aug 15, 2007 4:08 pm Post subject:

Why the heavy load? Run "du ." out of the RRA directory and post your results. Do you plan any more memory.

TheWitness

aleu · Cacti User Joined: 11 Dec 2006 Posts: 108

TheWitness · Posted: Wed Aug 15, 2007 9:06 pm Post subject:

Absolutely, if you were to have 8GB, your polling time would be under 15 seconds.

TheWitness

aleu · Cacti User Joined: 11 Dec 2006 Posts: 108

TheWitness · Posted: Wed Aug 15, 2007 11:39 pm Post subject:

I would play with 1-2 processes and no more than 20 threads on that box.

TheWitness

aleu · Cacti User Joined: 11 Dec 2006 Posts: 108

copo · Joined: 09 Oct 2006 Posts: 8

I'm trying to tune the performance on my box, and I have tried some of the changes to enhance the time for processing each polling cycle. Here are my config:

IBM x346
2 x XeonMP 3G
2 x SATA software mirror
1G RAM (another 3G is coming)
Fedora 7
Cacti 0.8.6j
Plugin Architecture 1.1
RRDTool 1.2.23

Here are my time:

After change to RRDTool 1.2.999 (1.3?)