Submit Your CMD.PHP vs. SPINE Metrics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Moderators, Developers

Post Reply
Author
Message
User avatar
TheWitness
Developer
Posts: 14834
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#316 Post by TheWitness » Mon May 16, 2011 10:13 am

Boris hit's the 1M mark!
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

exseven
Posts: 13
Joined: Tue Jun 24, 2008 9:57 am

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#317 Post by exseven » Tue May 31, 2011 2:30 pm

05/31/2011 03:15:15 PM - SYSTEM STATS: Time:14.1033 Method:spine Processes:2 Threads:8 Hosts:90 HostsPerProcess:45 DataSources:31971 RRDsProcessed:15059

HP ProLiant 320 G5p Xeon E3110 5GB RAM

copo
Posts: 11
Joined: Mon Oct 09, 2006 1:35 am

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#318 Post by copo » Sun Jul 03, 2011 11:14 pm

When the server is in it's 5min polling interval the page loads very slow, say, the page loads after 15 seconds after the click. I'm not sure if this is the disk bottleneck. This server solely for Cacti only and all the services are run on the same box include MySQL, HTTPD and RRD. The OS is installed on top of the bare hardware not VM. Any suggestion on boosting the performance? Thank you.


Operating system Redhat Linux Fedora 11
Kernel and CPU Linux 2.6.29.5-191.fc11.i686.PAE on i686
Processor information Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 4 cores (should be 2 physical CPUs)
Memory 2GB
Disks 3 x 73GB 10krpm RAID5 on IBM ServeRAID8k

07/04/2011 12:26:01 PM - SYSTEM STATS: Time:59.9841 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:21:06 PM - SYSTEM STATS: Time:64.6792 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:16:07 PM - SYSTEM STATS: Time:64.9832 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168

User avatar
TheWitness
Developer
Posts: 14834
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#319 Post by TheWitness » Mon Jul 04, 2011 9:41 am

copo wrote:When the server is in it's 5min polling interval the page loads very slow, say, the page loads after 15 seconds after the click. I'm not sure if this is the disk bottleneck. This server solely for Cacti only and all the services are run on the same box include MySQL, HTTPD and RRD. The OS is installed on top of the bare hardware not VM. Any suggestion on boosting the performance? Thank you.


Operating system Redhat Linux Fedora 11
Kernel and CPU Linux 2.6.29.5-191.fc11.i686.PAE on i686
Processor information Intel(R) Xeon(R) CPU E5405 @ 2.00GHz, 4 cores (should be 2 physical CPUs)
Memory 2GB
Disks 3 x 73GB 10krpm RAID5 on IBM ServeRAID8k

07/04/2011 12:26:01 PM - SYSTEM STATS: Time:59.9841 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:21:06 PM - SYSTEM STATS: Time:64.6792 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
07/04/2011 12:16:07 PM - SYSTEM STATS: Time:64.9832 Method:spine Processes:4 Threads:15 Hosts:169 HostsPerProcess:43 DataSources:23288 RRDsProcessed:7168
Use boost.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

copo
Posts: 11
Joined: Mon Oct 09, 2006 1:35 am

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#320 Post by copo » Mon Jul 04, 2011 11:30 pm

Thank you for the information. "Boost" seems to use memory for temporary storing poll results to reduce disk IO is that right? If that is correct will 2GB which is currently installed ok with that? We are willing to place more memory into the box but I'm thinking if we should try the plugin before hardware upgrade or we should add memory before using boost. Thanks.

rudw0lf
Posts: 6
Joined: Tue Nov 08, 2011 2:14 am
Location: Samara, Russia
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#321 Post by rudw0lf » Fri Nov 25, 2011 6:14 am

Operating system Oracle Linux 6.1
Kernel and CPU 2.6.32-131.17.1.el6.x86_64
Processor information Intel(R) Xeon(R) CPU E5335 @ 2.00GHz, 4 cores
Memory 2GB
On Hyper-V

Cacti 0.8.7h
Cacti OS unix
SNMP Version NET-SNMP version: 5.5.1
RRDTool Version RRDTool 1.3.x
Hosts 205
Graphs 3433
Data Sources Script/Command: 57
SNMP: 780
SNMP Query: 2754
Script Query: 18
Script - Script Server (PHP): 6
Script Query - Script Server: 142
Total: 3757

Poller Information
Interval 60
Type SPINE 0.8.7h Copyright 2002-2011 by The Cacti Group
Items Action[0]: 6462
Action[1]: 140
Action[2]: 178
Total: 6780
Concurrent Processes 24
Max Threads 60
PHP Servers 25
Script Timeout 30
Max OID 40
Last Run Statistics Time:19.9608 Method:spine Processes:24 Threads:60 Hosts:196 HostsPerProcess:9 DataSources:2027 RRDsProcessed:1113

PHP Version 5.3.3
PHP OS Linux
PHP SNMP Installed
max_execution_time 30
memory_limit 256M

User avatar
TheWitness
Developer
Posts: 14834
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#322 Post by TheWitness » Fri Nov 25, 2011 6:19 am

rudw0lf wrote:Operating system Oracle Linux 6.1
Kernel and CPU 2.6.32-131.17.1.el6.x86_64
Processor information Intel(R) Xeon(R) CPU E5335 @ 2.00GHz, 4 cores
Memory 2GB
On Hyper-V

Cacti 0.8.7h
Cacti OS unix
SNMP Version NET-SNMP version: 5.5.1
RRDTool Version RRDTool 1.3.x
Hosts 205
Graphs 3433
Data Sources Script/Command: 57
SNMP: 780
SNMP Query: 2754
Script Query: 18
Script - Script Server (PHP): 6
Script Query - Script Server: 142
Total: 3757

Poller Information
Interval 60
Type SPINE 0.8.7h Copyright 2002-2011 by The Cacti Group
Items Action[0]: 6462
Action[1]: 140
Action[2]: 178
Total: 6780
Concurrent Processes 24
Max Threads 60
PHP Servers 25
Script Timeout 30
Max OID 40
Last Run Statistics Time:19.9608 Method:spine Processes:24 Threads:60 Hosts:196 HostsPerProcess:9 DataSources:2027 RRDsProcessed:1113

PHP Version 5.3.3
PHP OS Linux
PHP SNMP Installed
max_execution_time 30
memory_limit 256M
Your max_connections better by > 1500 with such aggressive settings here. Seem's to be excessive IMHO.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

rudw0lf
Posts: 6
Joined: Tue Nov 08, 2011 2:14 am
Location: Samara, Russia
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#323 Post by rudw0lf » Fri Nov 25, 2011 6:32 am

But it works - graphs without interruption.

Joost
Posts: 7
Joined: Wed May 19, 2010 7:55 am
Location: Amsterdam, The Netherlands

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#324 Post by Joost » Wed Feb 01, 2012 3:27 pm

Time:8.4368 Method:spine Processes:8 Threads:8 Hosts:258 HostsPerProcess:33 DataSources:40150 RRDsProcessed:15208

BorisL
Cacti User
Posts: 131
Joined: Sat Mar 31, 2007 9:21 am
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#325 Post by BorisL » Thu Feb 09, 2012 3:24 am

02/09/2012 11:58:45 AM - SYSTEM STATS: Time:104.4574 Method:spine Processes:1 Threads:128 Hosts:2889 HostsPerProcess:2889 DataSources:2001681 RRDsProcessed:0
02/09/2012 12:03:50 PM - SYSTEM BOOST STATS: Time:1216.9600 RRDUpdates:21977438

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#326 Post by gandalf » Fri Feb 10, 2012 9:13 am

BorisL wrote:... DataSources:2001681 ... RRDUpdates:21977438
You shouldn't crawl the internet using Cacti :wink:
R.

chadd
Cacti User
Posts: 382
Joined: Thu Mar 24, 2005 3:53 pm
Location: Ocoee, Florida

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#327 Post by chadd » Fri Feb 10, 2012 11:13 am

[quote="atalatlae"]01/19/2011 06:17:35 PM - SYSTEM STATS: Time:18.5439 Method:spine Processes:6 Threads:1 Hosts:1071 HostsPerProcess:179 DataSources:40261 RRDsProcessed:18555
01/19/2011 06:16:33 PM - SYSTEM STATS: Time:16.8406 Method:spine Processes:6 Threads:1 Hosts:1071 HostsPerProcess:179 DataSources:40263 RRDsProcessed:19515

4 servers collect data
1 database with poller.php modified by me.

seya ![/quote]

If you could provide a short tutorial on how this is done, I would be grateful! I would like to offload polling to another box if possible. Actually, what would be great is if I could do an active/active Cacti server scenario. That way, I could meet DR requirements at the same time as reduce load on my one server.

I would also like to be able to go to 1min polling, or less on a case by case basis.. That I am sure is another discussion all together, but one I think the community should have. Right now we are using PRTG for sub 5min polling, on an as needed basis. In case your asking "WHY??", it is to make spikes in the datacenter visible - as Cacti, with 5min intervals tends to smooth the spikes out.

Any direction would be great! Thanks,

-chadd.

lmn40227
Posts: 1
Joined: Tue Apr 10, 2012 1:06 pm

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#328 Post by lmn40227 » Tue Apr 10, 2012 1:20 pm

I have limited threads to 30 in the latest version. How is performance affected when you reduce threads to 30? Also, please post the number of snmp, vs. scripts, vs. script_server DS's of those 37k (Action 0, Action 1, Action 2).

hmorandell
Cacti User
Posts: 72
Joined: Mon May 03, 2010 11:48 am

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#329 Post by hmorandell » Wed Apr 11, 2012 1:41 am

Tech info:


Cacti Version 0.8.8
Cacti OS unix
SNMP Version NET-SNMP version: 5.4.2.1
RRDTool Version RRDTool 1.3.x
Hosts 1356
Graphs 4076
Data Sources Script/Command: 199
SNMP: 270
SNMP Query: 3780
Script - Script Server (PHP): 4
Total: 4253
Poller Information
Interval 60
Type SPINE 0.8.7i Copyright 2002-2011 by The Cacti Group
Items Action[0]: 7594
Action[1]: 199
Action[2]: 4
Total: 7797
Concurrent Processes 1
Max Threads 50
PHP Servers 8
Script Timeout 35
Max OID 30
Last Run Statistics Time:57.0832 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7780 RRDsProcessed:4168
PHP Information
PHP Version 5.3.3
PHP OS Linux
PHP uname Linux hdtest 2.6.31.14-0.8-default #1 SMP 2011-04-06 18:09:24 +0200 i686
PHP SNMP Installed
max_execution_time 120
memory_limit 256M


Hardware is:
RAM: 2GB
CPU: Intel(R) Xeon(TM) CPU 2.40GHz


this is cacti performance:

04/11/2012 08:36:48 AM - SYSTEM STATS: Time:46.5914 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7780 RRDsProcessed:4168
04/11/2012 08:35:53 AM - SYSTEM THOLD STATS: Time:6.7310 Tholds:590 DownHosts:0
04/11/2012 08:35:46 AM - SYSTEM STATS: Time:44.6788 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7782 RRDsProcessed:4172
04/11/2012 08:34:57 AM - SYSTEM THOLD STATS: Time:6.7515 Tholds:590 DownHosts:0
04/11/2012 08:34:50 AM - SYSTEM STATS: Time:48.4414 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7779 RRDsProcessed:4169
04/11/2012 08:33:56 AM - SYSTEM THOLD STATS: Time:6.3436 Tholds:590 DownHosts:0
04/11/2012 08:33:50 AM - SYSTEM STATS: Time:48.9084 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7778 RRDsProcessed:4168
04/11/2012 08:33:00 AM - SYSTEM THOLD STATS: Time:6.2729 Tholds:590 DownHosts:0
04/11/2012 08:32:53 AM - SYSTEM STATS: Time:49.3778 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7778 RRDsProcessed:4168
04/11/2012 08:32:12 AM - SYSTEM THOLD STATS: Time:12.3947 Tholds:590 DownHosts:0
04/11/2012 08:31:59 AM - SYSTEM STATS: Time:57.0832 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7780 RRDsProcessed:4168
04/11/2012 08:31:03 AM - SYSTEM THOLD STATS: Time:6.8977 Tholds:590 DownHosts:0
04/11/2012 08:30:56 AM - SYSTEM STATS: Time:54.7367 Method:spine Processes:1 Threads:50 Hosts:1349 HostsPerProcess:1349 DataSources:7782 RRDsProcessed:4172

*******************
sorry - I can't get BB code to work, so formatting of post is not very well....

User avatar
_raindrop18
Cacti User
Posts: 194
Joined: Thu Jan 29, 2009 5:52 pm
Location: US

Re: Submit Your CMD.PHP vs. SPINE Metrics Here

#330 Post by _raindrop18 » Tue Apr 17, 2012 10:51 am

I am preparing to build new cacti 8.8 server and I need some feedback what I should improve on hardware side or any other setup. currently running on VM. thanks.

Date Tue, 17 Apr 2012 08:47:36 -0700
Cacti Version 0.8.7e
Cacti OS unix
SNMP Version NET-SNMP version: 5.4.2.1
RRDTool Version RRDTool 1.2.x
Hosts 589
Graphs 3144
Data Sources Script/Command: 426
SNMP: 771
SNMP Query: 1970
Script Query: 10
Script - Script Server (PHP): 167
Script Query - Script Server: 5
Total: 3349
Poller Information
Interval 300
Type spine
Items Action[0]: 4585
Action[1]: 285
Action[2]: 167
Total: 5037
Concurrent Processes 5
Max Threads 20
PHP Servers 5
Script Timeout 25
Max OID 10
Last Run Statistics Time:33.3697 Method:spine Processes:5 Threads:20 Hosts:545 HostsPerProcess:109 DataSources:5037 RRDsProcessed:3044
PHP Information
PHP Version 5.2.8
PHP OS SunOS
PHP uname SunOS server-1 5.10 Generic_144488-11 sun4v
PHP SNMP Not Installed
max_execution_time 60
memory_limit 128M

Post Reply