|
|
| Author |
Message |
TheWitness
Developer
Joined: 14 May 2002
Posts: 9723
Location: MI, USA
|
 Posted: Mon Nov 06, 2006 6:54 am Post subject: Testers Needed for Boost Plugin |
 |
|
Hello all, I am pretty close to completing a new plugin called Boost. It incorporates a few good features into Cacti to improve performance for larger sites and I am looking for some testers.
If you are interested, please post here your interest. I will make this the official posting location for the plugin and all "beta" versions.
So that you understand, here is what the plugin does:
This plugin boost's Cacti performance especially for Large Sites. It does this by introducing three new features to Cacti.
First, it recently viewed images to a public Cache folder. Second, it introduces an on demand RRD update feaure. This forces the update of RRD's prior to graph viewing and then schedules large batch RRD update's at pre-defined periods.
- Image Caching
- On Demand RRD Updates
- Optional RRD Update Service
- Host Subdirectories (TBD)
Regards,
TheWitness
Last edited by TheWitness on Thu Dec 21, 2006 3:23 pm; edited 1 time in total |
|
| Back to top |
|
 |
streaker69
Cacti Pro User
Joined: 27 Mar 2006
Posts: 647
Location: Psychic Amish Network Administrator
|
| Posted: Mon Nov 06, 2006 7:48 am Post subject: |
|
|
I know that N3NCY will be more than interested in testing it for you. May as well send it to him now before he has a chance to read this. 
|
|
| Back to top |
|
|
TheWitness
Developer
Joined: 14 May 2002
Posts: 9723
Location: MI, USA
|
| Posted: Mon Nov 06, 2006 11:46 am Post subject: |
|
|
He's signed up (willing or not  ) and has beta2 of the plugin. I don't know if he's attempted to use it yet. Are you interested in "testing"?
TheWitness
|
|
| Back to top |
|
|
streaker69
Cacti Pro User
Joined: 27 Mar 2006
Posts: 647
Location: Psychic Amish Network Administrator
|
| Posted: Mon Nov 06, 2006 1:34 pm Post subject: |
|
|
| I don't think I'd be a good test for it. I only have 17 hosts and 228 RRA's. Probably isn't going to have that much affect on me. Next spring I'll be doubling what I have as I'm converting a SCADA network into ethernet, but for now, I don't think it'd be worth it.
|
|
| Back to top |
|
|
moonman
Cacti User
Joined: 06 Sep 2003
Posts: 94
|
| Posted: Mon Nov 06, 2006 3:50 pm Post subject: |
|
|
I would like to beta test it.
I would also like to know what are the risks of the plugin (can it corrupt the DB or it can only cause lost of some updates in case of a failed update ) ?
My site have more then 5000 graphs
Thanks
|
|
| Back to top |
|
|
TheWitness
Developer
Joined: 14 May 2002
Posts: 9723
Location: MI, USA
|
| Posted: Mon Nov 06, 2006 3:54 pm Post subject: |
|
|
Moonman,
The plugin requires a new table called poller_output_boost. There are also modified files in the base install. It should be pretty harmless other than potential lost data. Before I perform a general release, I want to work out a few features.
At 5000 graphs, you should benefit from some reduced IO Wait times. You need to be cautious about database settings though. More to follow.
Larry
|
|
| Back to top |
|
|
Alice
Cacti User
Joined: 28 Oct 2003
Posts: 88
Location: Bucharest, RO.
|
| Posted: Wed Nov 08, 2006 11:33 am Post subject: |
|
|
285 devices, 2839 datasources, 1992 graphs and counting.
Do I qualify?
|
|
| Back to top |
|
|
TheWitness
Developer
Joined: 14 May 2002
Posts: 9723
Location: MI, USA
|
| Posted: Wed Nov 08, 2006 5:48 pm Post subject: |
|
|
Sure, but we are experiencing some issue's at the moment. I would prefer it if you have the same setup on a test box where you don't F$@# the production data. Can you do that?
Larry
|
|
| Back to top |
|
|
Frizz
Cacti User
Joined: 05 Mar 2005
Posts: 75
Location: Herne Germany
|
| Posted: Thu Nov 09, 2006 5:43 pm Post subject: Re: Testers Needed for Boost Plugin |
|
|
| TheWitness wrote: |
....
It incorporates a few good features into Cacti to improve performance for larger sites and I am looking for some testers.
...
|
Hello, thats what we wish for.
Performance for at least 10.000 devices with up to 100.000 RRD's.
As good as we have analyse it, 60% of our polling cycle was used for the RRDtool(update) function and not the polling of the SNMP data.
Currently we need about 170-180 sec for 33.000 RRD's from 1900 hosts, but we have sometime a jitter up to 300 sec as you can see in the attached graph.
Our used production enviroment for the Database/polling server
2 x 2.7GHz Xeon, Suse Linux 8.2 under VM/ESX server, 4GB RAM,IHS Webserver 2.0.42.1 ( IBM, based on Apache ), RRDTool 1.0.49, MySQL 4.0.24, PHP 4.3.8, Cacti 0.8.6g, Cactid 0.8.6f
A problem occurs , when the first polling process exceeded the 300 sec, the next scheduled cycle will need even more time, and so on.
We run in a polling loop.
The only process that has not finished is alway the RRDtool(update).
Killing this RRDtool processes and start the next poller manually until it's runtime fall below the 300 sec is the solution to clean up this loop.
So the idea to speed up the RRDtool process working only in RAM will be the right approach.
The structured RRD directory is also a good approach to overcome a Linux immanent (inode) problem.
| TheWitness wrote: |
...
If you are interested, please post here your interest. I will make this the official posting location for the plugin and all "beta" versions.
...
|
Yes we are interested to be "beta" tester on our prototype box, where we can tune up the count of RRD files up to the hardware limits.
If you are interested I will contact you via mail.
Best regards
Frizz
| Description: |
|
| Filesize: |
5.6 KB |
| Viewed: |
3711 Time(s) |
|
|
|
| Back to top |
|
|
Alice
Cacti User
Joined: 28 Oct 2003
Posts: 88
Location: Bucharest, RO.
|
| Posted: Fri Nov 10, 2006 2:37 pm Post subject: |
|
|
| TheWitness wrote: | Sure, but we are experiencing some issue's at the moment. I would prefer it if you have the same setup on a test box where you don't F$@# the production data. Can you do that?
Larry |
Certainly, I want to move my production system to another machine and I test everything on that right now
|
|
| Back to top |
|
|
TheWitness
Developer
Joined: 14 May 2002
Posts: 9723
Location: MI, USA
|
| Posted: Fri Nov 10, 2006 4:15 pm Post subject: |
|
|
Alice,
I sent you Beta7 via a PM. Please send e-mails regarding this subject to the distribution I will send you via e-mail momentarily. Remember, it's not ready for production at the moment.
Larry
|
|
| Back to top |
|
|
Alice
Cacti User
Joined: 28 Oct 2003
Posts: 88
Location: Bucharest, RO.
|
| Posted: Fri Nov 10, 2006 5:13 pm Post subject: |
|
|
Got it, thanx.
I'll try it on Monday.
|
|
| Back to top |
|
|
rock_manlove
Joined: 02 Oct 2006
Posts: 44
Location: NJ, USA
|
| Posted: Sun Nov 12, 2006 3:02 pm Post subject: |
|
|
I want to try Boost on my development Cacti.
Thanks.
|
|
| Back to top |
|
|
cwahlin
Cacti User
Joined: 10 Oct 2003
Posts: 87
|
| Posted: Mon Nov 13, 2006 1:21 pm Post subject: |
|
|
I'd be willing to test the boost plugin.
As you saw in my other post (http://forums.cacti.net/about17668.html) I am only running 50 hosts, but 8895 data sources  (Cisco 6509s with LOTS of interfaces and other things that need to be polled).
I am running my old server still so I won't lose any important data.
/Carl
|
|
| Back to top |
|
|
Alice
Cacti User
Joined: 28 Oct 2003
Posts: 88
Location: Bucharest, RO.
|
| Posted: Mon Nov 13, 2006 7:12 pm Post subject: |
|
|
I am sorry, but I am VERY busy these days 
Quick note, maybe it was MY fault, maybe not:
With logarithmic auto-scaling, when I tried to view graphs, the server allmost died. rrdtool was eating a lot of memory & CPU time.
I didn't ried to reproduce bug. As I said, I don't have time. Sorry.
|
|
| Back to top |
|
|
|
FAQ
Search
Memberlist
Register
Profile
Log in to check your private messages
Log in
