Submit your BOOST Statistics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Moderators, Developers

Author
Message
User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Submit your BOOST Statistics Here

#46 Post by TheWitness » Mon Dec 05, 2011 1:02 pm

If you use a combination of:

Code: Select all

./spine -R -S -V 3
You don't have to stop anything. It's a 'readonly' mode and will not cause polling issues. If you run either the 'h' version or to be released 'i' version, you get nice stats too.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

chadd
Cacti User
Posts: 382
Joined: Thu Mar 24, 2005 3:53 pm
Location: Ocoee, Florida

Re: Submit your BOOST Statistics Here

#47 Post by chadd » Mon Dec 05, 2011 2:11 pm

[quote="TheWitness"]If you use a combination of:

[code]./spine -R -S -V 3[/code]

You don't have to stop anything. It's a 'readonly' mode and will not cause polling issues. If you run either the 'h' version or to be released 'i' version, you get nice stats too.

TheWitness[/quote]


Tried to PM the results to you in a txt file attachment, but the forum does not seem to be in the uploading mood today. I will try again later.

-chadd.

chadd
Cacti User
Posts: 382
Joined: Thu Mar 24, 2005 3:53 pm
Location: Ocoee, Florida

Re: Submit your BOOST Statistics Here

#48 Post by chadd » Mon Dec 05, 2011 4:05 pm

[quote="chadd"][quote="TheWitness"]If you use a combination of:

[code]./spine -R -S -V 3[/code]

You don't have to stop anything. It's a 'readonly' mode and will not cause polling issues. If you run either the 'h' version or to be released 'i' version, you get nice stats too.

TheWitness[/quote]


Tried to PM the results to you in a txt file attachment, but the forum does not seem to be in the uploading mood today. I will try again later.

-chadd.[/quote]


Well, can't upload anything... Oh well. Here is the last line for two runs:

1.)
ERROR: Spine Timed Out While Processing Hosts Internal
Time: 299.8007 s, Threads: 10, Hosts: 894

2.)
Time: 309.4824 s, Threads: 10, Hosts: 894

Doesn't work well in RO mode I guess.

-chadd.

chadd
Cacti User
Posts: 382
Joined: Thu Mar 24, 2005 3:53 pm
Location: Ocoee, Florida

Re: Submit your BOOST Statistics Here

#49 Post by chadd » Tue Dec 06, 2011 1:38 pm

Upgraded to Spine 0.8.7i per TheWitness recommendations, and I realized an improvement in the poll times:

12/06/2011 01:31:17 PM - SYSTEM STATS: Time:75.6861 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 01:26:02 PM - SYSTEM STATS: Time:61.3048 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 01:21:13 PM - SYSTEM STATS: Time:71.5190 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 01:16:14 PM - SYSTEM STATS: Time:72.0344 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 01:11:18 PM - SYSTEM STATS: Time:76.2673 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 01:06:01 PM - SYSTEM STATS: Time:60.2945 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 01:01:01 PM - SYSTEM STATS: Time:59.6048 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 12:56:17 PM - SYSTEM STATS: Time:75.2897 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 12:51:24 PM - SYSTEM STATS: Time:82.8599 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 12:46:07 PM - SYSTEM STATS: Time:65.2572 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0
12/06/2011 12:41:08 PM - SYSTEM STATS: Time:66.7249 Method:spine Processes:16 Threads:10 Hosts:894 HostsPerProcess:56 DataSources:286149 RRDsProcessed:0

Thanks!

hid3nax
Cacti User
Posts: 68
Joined: Thu Jan 12, 2012 7:48 am

Re: Submit your BOOST Statistics Here

#50 Post by hid3nax » Thu Jan 12, 2012 11:16 am

Hello everyone.
Is it possible to use only one Boost's feature - to cahe PNGs?

Thank you.

BorisL
Cacti User
Posts: 131
Joined: Sat Mar 31, 2007 9:21 am
Contact:

Re: Submit your BOOST Statistics Here

#51 Post by BorisL » Tue Jan 24, 2012 11:00 am

[quote="hid3nax"]Hello everyone.
Is it possible to use only one Boost's feature - to cahe PNGs?

Thank you.[/quote]
Set "Maximum Records" lower than your DS items count and that will force Boost to flush RRD after each polling interval (if it will cope with this).

User avatar
TheWitness
Developer
Posts: 14817
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Re: Submit your BOOST Statistics Here

#52 Post by TheWitness » Tue Jan 24, 2012 12:27 pm

hid3nax wrote:Hello everyone.
Is it possible to use only one Boost's feature - to cahe PNGs?

Thank you.
If you simply enable only the Image caching, you will be all set.
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of MacTrack, Boost, CLog, SpikeKill, Platform RTM, DSStats, maintainer of Spine, lot's of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Central Plugin Repository
Central Templates Repository


I'm still out there people. Getting excited for Cacti 1.2. I think it will be a great release.

chadd
Cacti User
Posts: 382
Joined: Thu Mar 24, 2005 3:53 pm
Location: Ocoee, Florida

Re: Submit your BOOST Statistics Here

#53 Post by chadd » Tue May 08, 2012 10:52 am

[quote="chadd"][quote="gandalf"]Yeah, that's right. But where's the sense in 16 processes unless the system has that many cores?
R.[/quote]

[email protected]:~$ cat /proc/cpuinfo | grep processor | wc -l
16
[email protected]:~$


[email protected]:~$ cat /proc/meminfo
MemTotal: 37139664 kB
MemFree: 1355612 kB
Buffers: 237448 kB
Cached: 24029272 kB
SwapCached: 5760 kB
Active: 20767520 kB
Inactive: 13266812 kB
Active(anon): 8479808 kB
Inactive(anon): 1288076 kB
Active(file): 12287712 kB
Inactive(file): 11978736 kB
Unevictable: 0 kB
Mlocked: 0 kB
SwapTotal: 71084024 kB
SwapFree: 71041300 kB
Dirty: 6864 kB
Writeback: 0 kB
AnonPages: 9762420 kB
Mapped: 24112 kB
Shmem: 212 kB
Slab: 873684 kB
SReclaimable: 819200 kB
SUnreclaim: 54484 kB
KernelStack: 6336 kB
PageTables: 54928 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
WritebackTmp: 0 kB
CommitLimit: 89653856 kB
Committed_AS: 6735556 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 223864 kB
VmallocChunk: 34340142288 kB
HardwareCorrupted: 0 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
DirectMap4k: 8432 kB
DirectMap2M: 37730304 kB


But, the web interface is a bit slow to respond sometimes.. Haven't really spent much time figuring out why, but I suspect it is due to the size of the database.. I have syslog, mactrack, and configstore - all using A LOT of rows..

Any recommendations would be appreciated Gandalf. What would you recommend for Spine settings? Thanks in advance.

-chadd.[/quote]


System stats are still the same (as above). Upgrading spine did help speed up the poller a little, but I am still having the issue with the web interface being slow sometimes (seems that it is slow when the poller is running). The server load is always high, and the MySQL or PHP process(s) seem to be the ones taking the most CPU. I am thinking about getting another server to run everything but the database, and leaving the database on this server - but I am not sure it will make a lot of difference. Anyone have suggestions? My main concern is making the web interface more responsive (during polling cycles). Here are the latest stats from poller and plugins:

05/08/2012 11:46:38 AM - SYSTEM DSSTATS STATS: Type:HOURLY, Time:3.3903
05/08/2012 11:46:34 AM - SYSTEM THOLD STATS: Time:0.0011 Tholds:0 Hosts:0 (not really used right now)
05/08/2012 11:46:34 AM - SYSTEM STATS: Time:93.2368 Method:spine Processes:16 Threads:10 Hosts:903 HostsPerProcess:57 DataSources:301163 RRDsProcessed:0
05/08/2012 11:42:14 AM - SYSTEM SYSLOG STATS:Time:45.38 Deletes:0 Incoming:7717 Removes:0 XFers:7717 Alerts:0 Alarms:0 Reports:0

Post Reply