Cacti (home)ForumsRepositoryDocumentation
Cacti: offical forums and support  

 FAQFAQ   SearchSearch   MemberlistMemberlist    RegisterRegister   ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in    


Submit Your CMD.PHP vs. CACTID Metrics Here
Goto page Previous  1, 2, 3 ... 15, 16, 17
 
Post new topic   Reply to topic    Cacti Forum Index -> Announcements
Author Message
mccloud



Joined: 15 Jun 2007
Posts: 1
PostPosted: Tue Aug 26, 2008 7:44 am    Post subject: Reply with quote
08/26/2008 05:01:55 AM - SYSTEM STATS: Time:113.6542 Method:spine Processes:3 Threads:40 Hosts:1061 HostsPerProcess:354 DataSources:10779 RRDsProcessed:4474
Back to top
frdrk



Joined: 06 Jul 2007
Posts: 41
PostPosted: Thu Aug 28, 2008 7:01 am    Post subject: Reply with quote

08/28/2008 01:55:32 PM - SYSTEM STATS: Time:30.4682 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:50:30 PM - SYSTEM STATS: Time:28.8209 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27952
08/28/2008 01:45:34 PM - SYSTEM STATS: Time:32.6964 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:41:26 PM - SYSTEM STATS: Time:84.3668 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56577 RRDsProcessed:27962
08/28/2008 01:35:47 PM - SYSTEM STATS: Time:44.8065 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:30:46 PM - SYSTEM STATS: Time:45.5328 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:25:33 PM - SYSTEM STATS: Time:31.3891 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:20:27 PM - SYSTEM STATS: Time:26.3713 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:15:30 PM - SYSTEM STATS: Time:29.0295 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27926
08/28/2008 01:10:33 PM - SYSTEM STATS: Time:31.7093 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:05:39 PM - SYSTEM STATS: Time:36.9887 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936
08/28/2008 01:01:11 PM - SYSTEM STATS: Time:70.4295 Method:spine Processes:6 Threads:20 Hosts:1137 HostsPerProcess:190 DataSources:56525 RRDsProcessed:27936


After some memory-upgrades this system is running really smooth
Back to top
gandalf
Developer


Joined: 02 Dec 2004
Posts: 12206
Location: Muenster, Germany
PostPosted: Fri Aug 29, 2008 3:37 pm    Post subject: Reply with quote
WOW, that's decent! May you please post your server details?
Reinhard
Back to top
frdrk



Joined: 06 Jul 2007
Posts: 41
PostPosted: Sat Aug 30, 2008 7:03 am    Post subject: Reply with quote
gandalf wrote:
WOW, that's decent! May you please post your server details?
Reinhard


Dell 1955 blade, dual quad xeon E5335 2Ghz, 18Gb ram, 2*73Gb 10Krpm SAS in raid1. Running debian etch with 2.6.18-6-686-bigmem kernel and rrdtool 1.3.1.

I'm still having some 'problems' with runtimes ex. when I add some new devices, and at 2AM when there is alot of rrd-stuff happening;
08/30/2008 02:10:50 AM - SYSTEM STATS: Time:46.3380 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 02:05:46 AM - SYSTEM STATS: Time:44.2632 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 02:02:26 AM - SYSTEM STATS: Time:144.0773 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337
08/30/2008 01:55:31 AM - SYSTEM STATS: Time:30.3803 Method:spine Processes:6 Threads:20 Hosts:1152 HostsPerProcess:192 DataSources:57241 RRDsProcessed:28337


I'm still running 32bit system (had 2Gb memory in the box up untill last week, damn that extra 16Gb made a difference ), so I'm thinking about reinstalling the box with a 64-bit system to make better use of the memory, and see if I maybe can tune mysql or something. I guess the disks will be my next bottleneck, I would really like to put the rra's on a different disk than the rest of the installation, but that's the sucky part of this otherwise great blade.. it only got space for 2 disks, so then I won't be able to raid them. So I guess this will have to do for now.

Any tips to further increase performance is highly appreciated

cacti.jpg
 Description:
Timeline of some updates
 Filesize:  193.97 KB
 Viewed:  813 Time(s)

cacti.jpg
Back to top
peecee



Joined: 26 Feb 2008
Posts: 44
PostPosted: Fri Oct 10, 2008 1:01 pm    Post subject: Reply with quote
Here are my stats after running for almost 6 months...

10/10/2008 01:47:06 PM - SYSTEM BOOST STATS: Time:600.7716 RRDUpdates:1506501
10/10/2008 01:47:05 PM - SYSTEM STATS: Time:123.2782 Method:spine Processes:12 Threads:4 Hosts:1431 HostsPerProcess:120 DataSources:20379 RRDsProcessed:11298

Any suggestions for how to optimize? I'm getting occasional errors like this:

10/10/2008 01:47:07 PM - CMDPHP: Poller[0] FATAL: RRD On Demand Updater Exceeded Runtime Limits!!!
Back to top
lints



Joined: 08 Nov 2007
Posts: 25
Location: Ottawa, Canada
PostPosted: Fri Oct 10, 2008 1:20 pm    Post subject: Reply with quote
10/10/2008 02:10:57 PM - SYSTEM STATS: Time:55.5647 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:06:25 PM - SYSTEM STATS: Time:83.3740 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 02:00:56 PM - SYSTEM STATS: Time:54.7026 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:55:53 PM - SYSTEM STATS: Time:51.5866 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:51:22 PM - SYSTEM STATS: Time:80.2035 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:46:24 PM - SYSTEM STATS: Time:83.2492 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:40:52 PM - SYSTEM STATS: Time:50.8180 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:35:51 PM - SYSTEM STATS: Time:49.2804 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:31:05 PM - SYSTEM STATS: Time:64.2670 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:25:52 PM - SYSTEM STATS: Time:50.4442 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:20:50 PM - SYSTEM STATS: Time:47.7887 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:17:36 PM - SYSTEM STATS: Time:154.6632 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769
10/10/2008 01:11:08 PM - SYSTEM STATS: Time:66.1795 Method:spine Processes:12 Threads:25 Hosts:154 HostsPerProcess:13 DataSources:10031 RRDsProcessed:4769

Running on an HP DL380 G4; dual dual-core 3.20GHz Intel Xeon; 3 GB of RAM, 2*36GB 15K disk for OS in RAID 1, 4*72GB disks for data in RAID 5.

Quote:
Cacti Version - 0.8.7b
Plugin Architecture - 2.1
Poller Type - Cactid v
Server Info - Linux 2.6.18-53.el5
Web Server - Apache/2.2.3 (CentOS)
PHP - 5.1.6
PHP Extensions - libxml, xml, wddx, tokenizer, sysvshm, sysvsem, sysvmsg, standard, SimpleXML, sockets, SPL, shmop, session, Reflection, pspell, posix, mime_magic, iconv, hash, gmp, gettext, ftp, exif, date, curl, ctype, calendar, bz2, zlib, pcre, openssl, apache2handler, dbase, gd, json, ldap, mbstring, mysql, mysqli, PDO, pdo_mysql, pdo_sqlite, rrdtool, snmp
MySQL - 5.0.22-log
RRDTool - 1.2.23
SNMP - 5.3.1
Plugins
    Global Plugin Settings (settings - v0.5)
    Thresholds (thold - v0.3.9)
    Large Site Performane Booster for Cacti (boost - v1.8)
    Host Info (hostinfo - v0.2)
    Cycle Graphs (Cycle Graphs - v0.4)
    Device Monitoring (monitor - v0.8.2)
    Network Tools (tools - v0.3)
    killspike (killspike - v0.1.0a)
    Update Checker (update - v0.4)
Back to top
computer_guru



Joined: 10 Apr 2008
Posts: 18
PostPosted: Tue Nov 18, 2008 12:23 pm    Post subject: Optimal Settings Reply with quote
I've been trying to find the optimal settings of processes and threads by reading in this topic. Here are my results. Any feedback would be great.


Time:33.4453 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:155
Time:33.0334 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:153
Time:32.4967 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:156
Time:38.9115 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:159
Time:52.2100 Method:spine Processes:2 Threads:30 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
Time:56.3337 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:57.2530 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:278 RRDsProcessed:155
Time:54.2952 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:158
Time:54.3770 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:283 RRDsProcessed:162
Time:56.7570 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:159
Time:56.7095 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:280 RRDsProcessed:155
Time:54.0052 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:276 RRDsProcessed:155
Time:53.9228 Method:spine Processes:6 Threads:20 Hosts:187 HostsPerProcess:32 DataSources:284 RRDsProcessed:156
Time:44.6062 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:45.5313 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:47.0882 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:151
Time:43.4350 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:41.2545 Method:spine Processes:4 Threads:25 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:38.5832 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:285 RRDsProcessed:162
Time:39.4540 Method:spine Processes:3 Threads:15 Hosts:187 HostsPerProcess:63 DataSources:280 RRDsProcessed:159
Time:44.3088 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:155
Time:44.0469 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:276 RRDsProcessed:155
Time:44.5946 Method:spine Processes:4 Threads:10 Hosts:187 HostsPerProcess:47 DataSources:284 RRDsProcessed:158
Time:43.0379 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:285 RRDsProcessed:162
Time:40.2794 Method:spine Processes:4 Threads:6 Hosts:187 HostsPerProcess:47 DataSources:280 RRDsProcessed:159
Time:33.3341 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:151
Time:37.3519 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:276 RRDsProcessed:155
Time:32.6199 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:284 RRDsProcessed:158
Time:33.6118 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:283 RRDsProcessed:157
Time:31.7842 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:158
Time:31.9777 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Time:32.7864 Method:spine Processes:2 Threads:50 Hosts:187 HostsPerProcess:94 DataSources:278 RRDsProcessed:155


PowerEdge 1750
Two Xeon Processors
Either 4 or 8 GB of ram

CactiEZ 0.4 (CentOS)
Cacti 0.8.7b

** Update ***

I killed two spine processes that were stuck. Results below:

11/18/2008 09:33:29 AM - SYSTEM STATS: Time:26.3965 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:285 RRDsProcessed:159
11/18/2008 09:32:29 AM - SYSTEM STATS: Time:26.2987 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:282 RRDsProcessed:162
11/18/2008 09:31:29 AM - SYSTEM STATS: Time:26.3429 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:159
11/18/2008 09:30:29 AM - SYSTEM STATS: Time:26.2473 Method:spine Processes:2 Threads:55 Hosts:187 HostsPerProcess:94 DataSources:280 RRDsProcessed:154
Back to top
gandalf
Developer


Joined: 02 Dec 2004
Posts: 12206
Location: Muenster, Germany
PostPosted: Thu Nov 20, 2008 11:11 am    Post subject: Reply with quote
I'd like to reduce threads to 10-15.
Are you running lots of scripts?
What about average latency to your targets? Are you able to use SNMP V2?
Around 30 sec. for 300 data sources is HUGE. We do 25k Data Sources in around 60-70 sec (which is bad as well)
Reinhard
Back to top
Display posts from previous:   
Post new topic   Reply to topic    Cacti Forum Index -> Announcements All times are GMT - 5 Hours
Goto page Previous  1, 2, 3 ... 15, 16, 17
Page 17 of 17

 



Powered by phpBB © 2001, 2005 phpBB Group