[XML] successor to apachestats 0.4

gandalf · Last edited by gandalf on Sun Mar 09, 2008 5:53 am; edited 3 times in total

Script was updated due to initialization errors. Please replace old one
Templates have been updated due to errors with newer cacti versions
This post is based on http://forums.cacti.net/viewtopic.php?t=4028 which contains the well know apachestats XML of Rolf Poser. Due to several questions arising (and some fun to have yet another simple perl script), I extended both two of the existing Graph Templates as well as implementing two new ones.
I did not include the docs from Rolf, as they hold for this version as well.
The script is based on the ws_apachestats_hs.pl, so it uses wget. This may as well be adjusted at your own. It has been enhanced in two ways:
- it includes CPULoad and Thread Scoreboard output
- output is performed in one single "print" statement to overcome possible problems using cactid

With later cacti versions, problems were reported with two of the graphs, the "Bytes/Requets" and the "Thread Details (%)" one. These have been corrected as they were due to the fact, that LINEx statements without color were defined.

Explanation of the Output for the "Thread Scoreboard" is best done using the "server-status" URL at your Webserver (e.g. http://<your webserber>/server-status)

ATTENTION
This script extends the Apache Webserver Data Template. So be careful, if you are using the apachestats-0.4 already! As well, the existing Apachestats Graph Templates will be modified!
At the moment, I do not know any way, to modify existing RRDs to include the additional Data Sources needed for CPULoad and Thread Scoreboard (perhaps export/manually modify/import will do?)
SO IT IS WISE NOT TO IMPORT DIRECTLY TO A PRODUCTION SYSTEM
If anyone knows a better way to do this, I'll appreciate to here from you.

Multiple RRDs
Due to the lack of my knowledge of the cacti system, I was not able to suppress the generation of one RRD for each of the Graph Templates. So, if you are going to define all 7 Graph Templates, you will notice 7 RRDs as well. All of them will hold "the same" data. The webserver is inquired 7 times for the same set of data. This is not a desired behaviour. There is a chance to get rid of 6 of them manually (Well, I did this yesterday, but took me "some time". It seems not that easy to describe this here)

As always, use this at your own risk.
Comments, enhancements and the like are appreciated

happy cactiing
Reinhard

gandalf · Posted: Sun Oct 16, 2005 2:31 pm Post subject:

Just did some tweaking with the "old" and the "new" templates to check any oddities in the mixture of both.
First, I cleared all my "old" resources: Existing Graphs and RRDs as well as all ApacheStats Graph, Data and Host Templates; even the CDEFs.
The I imported the ApacheStats 0.4 Templates and build all 5 Graphs (well, I had to tweak the both corrupted ones as described above to get them to work). This all went fine, as desired.
Now I imported the new ApacheStats Templates. Import went well

. Not to forget the new ws_apachestats.pl script!
Checked all Templates, they look as desired.
At last I build both new Graph Templates (CPULoad and Thread Scoreboard). No probs up to this.
I seems, that "overloading" existing Data Templates in this way does not confuse cacti!

The last thing remains: Both new templates will create their own RRDs.

I hope this will ease upgrading ...
Reinhard

JJX · Cacti User Joined: 06 Oct 2005 Posts: 171

i am facing a strange(?) error:

gandalf · Posted: Tue Oct 18, 2005 9:33 am Post subject:

You'll have to feed the hostname to the script. This should be done via the Data Input Method. It should have one Input Parameter, <hostname>. This should, of course, be done by the Host Template you have imported. Please post the screen of your Data Input Method for Apache Webstats.
Reinhard

JJX · Cacti User Joined: 06 Oct 2005 Posts: 171

here is a screenshot - it looks fine

gandalf · Posted: Wed Oct 19, 2005 9:00 am Post subject:

Yes, indeed, looks as expected. So I'll have to have a more detailed view at it.
Reinhard

pyoung · Joined: 07 Nov 2005 Posts: 13

How did you pare down the script so it's not storing duplicated RRD data?

gandalf · Posted: Tue Nov 08, 2005 5:30 pm Post subject:

Ingimar · Joined: 21 Feb 2005 Posts: 7

Hi there.

I just installed the Apache status. I have extended status on in httpd.conf and access to /server-status works fine. I run the ws_apachestats.pl script and the output seems fine:

gandalf · Posted: Sat Nov 12, 2005 4:58 am Post subject:

This may be related to rrdtool 1.0.x. I used the TREND function. You may delete the "30 min moving average" items out of the graph template to get rid of this
Reinhard

Ingimar · Joined: 21 Feb 2005 Posts: 7

suse · Joined: 13 Nov 2005 Posts: 23

one problem
I found
CACTID: Host[3] ERROR: Empty result [hostname]: 'perl /home/mrtg/cacti/scripts/ws_apachestats.pl hostname'
CACTID: Host[3] DS[84] WARNING: Result from SCRIPT not valid. Partial Result: ...

but if I ran perl /home/mrtg/cacti/scripts/ws_apachestats.pl hostname
I can get this
apache_total_hits:3424769 apache_total_kbytes:4463443333 apache_busy_workers:179 apache_idle_workers:31 thread_O:290 threadC:5 threadD:0 threadG:0 threadI:0 threadK:66 threadL:0 threadR:5 threadS:0 threadW:103 thread_W:31 apache_cpuload:.0389393

so why my data can not be polled?

gandalf · Posted: Wed Nov 16, 2005 3:31 pm Post subject:

stevewest15 · Joined: 25 Oct 2005 Posts: 9

Hi,

Great job on this script! I'm a newbie and trying to figure out why 4 of the graphs don't plot (Bytes/Request, CPU Load, Hits/s, & Kbits/s). Not sure where to look at trouble shooting. Here is what I'm seeing in my cacti/log/cacti.log:

gandalf · Posted: Wed Dec 07, 2005 3:42 pm Post subject:

The Script uses the /server-status?auto URL and parses the output. Please post the output of your webserver when pointing to that url
Reinhard