Submit Your CMD.PHP vs. SPINE Metrics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Moderators, Developers

Post Reply
Author
Message
kenfury
Posts: 3
Joined: Wed Dec 29, 2004 5:33 pm

Submit Your CMD.PHP vs. SPINE Metrics Here

#1 Post by kenfury » Thu Jan 27, 2005 1:16 am

What a change. I ran cmd.php every 60 seconds and I was getting into 40 second range for the scripts to run. Now I am down to 2.3-2.7 seconds with cactid. Quick specs...

Network Devices
---------------------

24 Cisco 3600 with 4 interfaces
1 Cisco 7200 with over 40 interfaces
3 Cisco 3550 12 interfaces
5 Cisco 3750 48 interfaces
48 Printers
10 servers (just Eth monitoring)

The Server
-----------------
IBM 335
Dual 2.4 Xeon
1 gig ram
U160 SCSI
Fedora Core1
Cactid 8.6d
cmd.php 8.6c

Cmd.php was running in the 2.8 to 3.4 load range for 5 min avg. Now with cactid I am running in the .5 to.7 range. cactid is running 2 threads vs 8 poller process with cmd.php. What a great upgrade.

Mikf
Posts: 47
Joined: Fri Aug 13, 2004 11:35 am
Location: Paris, France

#2 Post by Mikf » Thu Jan 27, 2005 1:53 pm

Hello,

here my test :
01/27/2005 07:50:16 PM - SYSTEM STATS: Time: 15.5160 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:45:17 PM - SYSTEM STATS: Time: 15.1279 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:40:19 PM - SYSTEM STATS: Time: 17.1653 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:35:24 PM - SYSTEM STATS: Time: 22.8908 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:31:17 PM - SYSTEM STATS: Time: 75.8915 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21
01/27/2005 07:25:50 PM - SYSTEM STATS: Time: 49.4887 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21
01/27/2005 07:20:48 PM - SYSTEM STATS: Time: 46.9298 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21
01/27/2005 07:16:00 PM - SYSTEM STATS: Time: 59.3676 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21



for 162 hosts (2829 data sources)
(routers, filers, caches, firewalls, windows, linux, solaris)

IBM Bi-Xeon 2.8Ghz
1G RAM

cacti 0.8.6c
cactid 0.8.6d

edit : new stats
03/02/2005 10:15:56 AM - SYSTEM STATS: Time: 54.2769 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
03/02/2005 10:11:04 AM - SYSTEM STATS: Time: 63.4464 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
03/02/2005 10:06:09 AM - SYSTEM STATS: Time: 68.1267 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
03/02/2005 10:01:19 AM - SYSTEM STATS: Time: 78.2936 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
Last edited by Mikf on Wed Mar 02, 2005 4:19 am, edited 1 time in total.

User avatar
TheWitness
Developer
Posts: 14804
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#3 Post by TheWitness » Thu Jan 27, 2005 1:57 pm

Hi, here are some production numbers:

Dell PowerEdge 6350
Quad Xenon 550
2 GBytes RAM
(Old Horse)

> 178 Hosts
> 5000 Data Sources
> Mixture of SNMPv1 and SNMPv2 Devices

CMD.PHP
8 Processes, Average: 160 Seconds

CACTID
4 Processes, 8 Threads Each, Average 40 Seconds
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

Ev
Cacti User
Posts: 104
Joined: Tue Jan 25, 2005 12:16 pm

#4 Post by Ev » Mon Jan 31, 2005 5:24 am

Sun Ultra 60 (2* USparc 440 Mhz) 1 G ram. Under heavy load (another monitoring program + old rrd).

62 hosts, ~670 data sources.

4* cmd.php - 200..240 sec.
1* cactid * 5 threads - 28..40 sec.

78 hosts with cactid - same time, 30..40 sec.

Can anyone wrote about it's stability of Cactid under Solaris (and under other Unix) ?

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

#5 Post by gandalf » Fri Feb 25, 2005 11:16 am

IBM Dual Xeon
RH Linux
Cactid 8.6d
cacti 0.8.6c

About 17 to 18 sec. for cactid, 2 Processes, 8 Threads, 133 Hosts, 1390 rrds. Cactid seems to be about 6 times faster than cmd.php.
The above contains some dozen data sources that are queried using perl scripts parsing html output (apache stats and so on)

aaa111
Posts: 3
Joined: Tue Nov 23, 2004 12:55 am

Re: >> Submit Your CMD.PHP vs. CACTID Metrics Here

#6 Post by aaa111 » Mon Feb 28, 2005 1:12 am

SYSTEM STATS: Time: 250.9287 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
# ls -1 rra/ | wc -l
2286

FreeBSD 5.3-STABLE #6
CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2392.29-MHz 686-class CPU)
real memory = 1073676288 (1023 MB)

User avatar
TheWitness
Developer
Posts: 14804
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

#7 Post by TheWitness » Mon Feb 28, 2005 5:58 am

aaa111,

Increase your thread count to 10 and repost.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

aaa111
Posts: 3
Joined: Tue Nov 23, 2004 12:55 am

#8 Post by aaa111 » Wed Mar 02, 2005 1:41 am

TheWitness wrote:aaa111,

Increase your thread count to 10 and repost.

TheWitness
about system: virtual host, based on jail.
load averages: 7,41 4,38 3,80


before:
03/02/2005 08:54:08 AM - SYSTEM STATS: Time: 247.5776 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
03/02/2005 08:59:34 AM - SYSTEM STATS: Time: 273.4089 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
03/02/2005 09:04:21 AM - SYSTEM STATS: Time: 260.9941 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
03/02/2005 09:09:33 AM - SYSTEM STATS: Time: 272.8332 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31

after:
03/02/2005 09:14:27 AM - SYSTEM STATS: Time: 267.1197 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31
03/02/2005 09:19:49 AM - SYSTEM STATS: Time: 287.9956 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31
03/02/2005 09:24:37 AM - SYSTEM STATS: Time: 276.7104 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31
03/02/2005 09:29:52 AM - SYSTEM STATS: Time: 291.8246 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31

PS: cacti has tools for profiling ?

Ev
Cacti User
Posts: 104
Joined: Tue Jan 25, 2005 12:16 pm

#9 Post by Ev » Wed Mar 02, 2005 3:24 am

aaa111 wrote:
TheWitness wrote:aaa111,

Increase your thread count to 10 and repost.

TheWitness
about system: virtual host, based on jail.
load averages: 7,41 4,38 3,80
^^^^^^^^^^^^^^^^^^^

high load.

Mikf
Posts: 47
Joined: Fri Aug 13, 2004 11:35 am
Location: Paris, France

to increase the speed

#10 Post by Mikf » Wed Mar 02, 2005 4:17 am

aaa111,

try with /usr/local/share/snmp/mibs empty. (or the good path to the mibs files of net-snmp)

- mikf

carcass
Posts: 4
Joined: Sun Jan 02, 2005 6:44 pm

#11 Post by carcass » Thu Mar 10, 2005 11:34 am

P4 2.4 without HyperThreading

cactid one a minute:
03/10/2005 06:01:08 PM - SYSTEM STATS: Time: 7.4417 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13
03/10/2005 06:02:05 PM - SYSTEM STATS: Time: 4.9023 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13
03/10/2005 06:03:05 PM - SYSTEM STATS: Time: 4.8770 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13
03/10/2005 06:04:06 PM - SYSTEM STATS: Time: 5.1839 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13

all devices are cisco catalysts. 1251 rrds.

03/10/2005 06:08:27 PM - SYSTEM STATS: Time: 26.7298 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 63, Hosts/Process: 13
03/10/2005 06:09:25 PM - SYSTEM STATS: Time: 25.7774 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 63, Hosts/Process: 13

turning on 28 ZYXEL dslams:

cactid
03/10/2005 06:18:18 PM - SYSTEM STATS: Time: 17.7232 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 91, Hosts/Process: 19
03/10/2005 06:19:17 PM - SYSTEM STATS: Time: 17.1713 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 91, Hosts/Process: 19

cmd.php
03/10/2005 06:32:55 PM - SYSTEM STATS: Time: 51.0815 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 91, Hosts/Process: 19
03/10/2005 06:33:48 PM - SYSTEM STATS: Time: 47.9127 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 91, Hosts/Process: 19

3000 rrds now

Rossco
Cacti User
Posts: 76
Joined: Sat Jan 15, 2005 4:52 pm
Location: London, England

cacti speeds

#12 Post by Rossco » Tue Mar 15, 2005 5:25 pm

Never got cmd.php to work for some reason, but these are my stats using cactid on a dual 2.8Ghz(with Hyperthreading) with 1GB RAM(windows2k).

Majority of these are Cisco routers and switches across 34 sites polling every 5 mins, approx 50 windows boxes. Total of 12,210 seperate rrds/datasources.


3/15/2005 10:11:31 PM - SYSTEM STATS: Time: 91.0645 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346,Hosts/Process: 173
03/15/2005 10:07:32 PM - SYSTEM STATS: Time: 151.8085 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173
03/15/2005 10:01:39 PM - SYSTEM STATS: Time: 99.5154 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173
03/15/2005 09:56:31 PM - SYSTEM STATS: Time: 90.8879 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173
03/15/2005 09:51:31 PM - SYSTEM STATS: Time: 91.3955 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173

Kind regards
Ross

ssams
Cacti User
Posts: 65
Joined: Tue Feb 01, 2005 5:54 pm
Location: Texas
Contact:

#13 Post by ssams » Mon Mar 21, 2005 3:39 pm

1 thread
03/21/2005 01:31:40 PM - SYSTEM STATS: Time: 100.7504 s, Method: cactid, Processes:
1, Threads: 1, Hosts: 90, Hosts/Process: 90

10 threads
03/21/2005 01:35:23 PM - SYSTEM STATS: Time: 22.5106 s, Method: cactid, Processes: 1, Threads: 10, Hosts: 90, Hosts/Process: 90


cmd was failing on max time.

approximately 2000 rras and growing. will probably hit 10000 when i am done.

User avatar
fmangeant
Cacti Guru User
Posts: 2326
Joined: Fri Sep 19, 2003 8:36 am
Location: Sophia-Antipolis, France
Contact:

#14 Post by fmangeant » Mon Apr 04, 2005 4:26 am

Hi all

I changed this morning from Cacti 0.8.6c cmd.php (20 pollers) :

Code: Select all

04/04/2005 09:47:50 AM - SYSTEM STATS: Time: 169.9051 s, Method: cmd.php, Processes: 20, Threads: N/A, Hosts: 537, Hosts/Process: 27
to Cacti 0.8.6c + cactid 0.8.6d (4 pollers w/ 15 threads) :

Code: Select all

04/04/2005 11:25:56 AM - SYSTEM STATS: Time: 44.6722 s, Method: cactid, Processes: 4, Threads: 15, Hosts: 537, Hosts/Process: 108
Total of 6000 rras (SNMP and Nagios, on Unix/NT hosts).

Here's an update, after 3 months running cactid :

Code: Select all

07/04/2005 03:46:11 PM - SYSTEM STATS: Time: 69.4416 s, Method: cactid, Processes: 4, Threads: 15, Hosts: 567, Hosts/Process: 142, Data Sources 7879, RRDs Processed 6042
I'm now having 7500 rras.
Last edited by fmangeant on Mon Jul 04, 2005 9:21 am, edited 2 times in total.
[size=84]
[color=green]HOWTOs[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15353]Install and configure the Net-SNMP agent for Unix[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=26151]Install and configure the Net-SNMP agent for Windows[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=28175]Graph multiple servers using an SNMP proxy[/url][/list]
[color=green]Templates[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15412]Multiple CPU usage for Linux[/url]
[*][url=http://forums.cacti.net/viewtopic.php?p=125152]Memory & swap usage for Unix[/url][/list][/size]

Kap
Posts: 1
Joined: Fri Feb 25, 2005 10:53 am

#15 Post by Kap » Wed Apr 06, 2005 11:54 am

04/06/2005 12:12:50 PM - SYSTEM STATS: Time: 50.1300 s, Method: cmd.php, Processes: 4, Threads: N/A, Hosts: 112, Hosts/Process: 29

04/06/2005 12:37:07 PM - CACTID: Poller[0] Time: 7.3960 s, Threads: 4, Hosts: 29


112 Devices
2832 Data Sources
MySQL 4.0.24 | Net-SNMP 5.2.1 | IIS 6| PHP 5.0.3 | RRDtool 1.0.49 | ActivePerl 5.8.6.811 | Windows 2003 Standard | AMD Athlon 2400+, 512MB RAM

Post Reply