|
|
| Author |
Message |
mmealman
Joined: 18 May 2007
Posts: 2
|
 Posted: Fri May 18, 2007 2:41 pm Post subject: Web Page Load Time |
 |
|
This is a monitor which will track the time it takes for a specific web page to load. It's useful for trending how long various pages are taking to load and is useful for tuning and tracking down system problems. Like if you see your CPU spiking at set times, running this would let you know if it's affecting your website response times.
This should run on Linux / Unix, but the page_load_time.pl script will need to be modified to point to the proper locations of time and wget.
For servers with multiple websites I've just been creating new "devices"(www.mysite.com www.myothersite.com) and attaching this monitor to them.
| Description: |
|
Download |
| Filename: |
page_load_time.tar.gz |
| Filesize: |
2.7 KB |
| Downloaded: |
222 Time(s) |
Last edited by mmealman on Mon May 21, 2007 9:14 am; edited 1 time in total |
|
| Back to top |
|
 |
hermes404
Joined: 27 Oct 2006
Posts: 3
|
| Posted: Mon May 21, 2007 7:39 am Post subject: |
|
|
hello Mealman, i tried you'r script. But it doesn't work.
If i run it, i get the following error:
[root@nms:scripts]# perl page_load_time.pl www.retecool.com index.php
avg:Error[root@nms:scripts]#
Wget/time/perl are installed on the system, wget was however installed in /usr/bin so i changed the location in page_load_time.pl file.
Any idea what the problem is?
|
|
| Back to top |
|
|
danathane
Cacti User
Joined: 03 May 2007
Posts: 127
|
| Posted: Mon May 21, 2007 7:54 am Post subject: |
|
|
hello.
don't you forget the / between www.retecool.com and index.php
If so, try with the /.
Bye
|
|
| Back to top |
|
|
hermes404
Joined: 27 Oct 2006
Posts: 3
|
| Posted: Mon May 21, 2007 8:13 am Post subject: |
|
|
Thank you danathane,
Good point, i guess I wasn't paying attention when posting. I initially tried with the dash, but when posting and trying it again I forget it.
I altered the Perl script and tried to echo the $time variable I got an error that "uninitialized value in string ". When I echo the $results variable I got "0.00user 0.02system 0:02.01elapsed 1%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+400minor)pagefaults 0swaps"
I'm not sure what value is expected. Would you try to run the following command:"/usr/bin/time /usr/bin/wget -T 30 -o /tmp/page_checks/tmp.log -p --no-cache -nd -P /tmp/page_checks/ http://www.retecool.com/index.php"
So I can check what answer I should get.
|
|
| Back to top |
|
|
danathane
Cacti User
Joined: 03 May 2007
Posts: 127
|
| Posted: Mon May 21, 2007 8:18 am Post subject: |
|
|
hello hermes,
I think that you are using a linux computer, and i am on a windows one, moreover, cacti isn't install on it. And i can't do what i want on it.
I'll tried that tonight at home.
Sorry
|
|
| Back to top |
|
|
hermes404
Joined: 27 Oct 2006
Posts: 3
|
| Posted: Mon May 21, 2007 8:35 am Post subject: |
|
|
You'r right! The macine is running CentOS 4.3 (2.6.9-34.EL) , i assumed the script was created on a linux based os.
I guess the Perl if regular expression comparison isn't okay since he give's zero output. However I
|
|
| Back to top |
|
|
danathane
Cacti User
Joined: 03 May 2007
Posts: 127
|
| Posted: Mon May 21, 2007 8:46 am Post subject: |
|
|
| HUm I was hinking abbout something. Have you tried with an othe website? I am not sure that the script was designed in this way, but you could tried
|
|
| Back to top |
|
|
mmealman
Joined: 18 May 2007
Posts: 2
|
| Posted: Mon May 21, 2007 9:10 am Post subject: |
|
|
Try this page_load.pl script:
| Code: |
#!/usr/bin/perl -w
$WGET = "/usr/bin/wget";
$TIME = "/usr/bin/time";
$host = $ARGV[0];
$url = $ARGV[1];
$check = "$TIME -p $WGET -T 30 -o /tmp/page_checks/tmp.log -p --no-cache -nd -P /tmp/page_checks/ http://" . $host . $url . " 2>&1";
$results = `$check`;
if($results =~ m/\s*real\s+(\d+\.\d+)/) {
$time = $1;
} else {
$time = "Error";
}
print "avg:$time";
|
I wrote it originally on FreeBSD, this one should be more portable.
|
|
| Back to top |
|
|
hermes404
Joined: 27 Oct 2006
Posts: 3
|
| Posted: Tue May 22, 2007 5:03 am Post subject: |
|
|
Great, It works now!
I already figured the p switch out, but I was stuck with the regular expression. Im new to regular expressions but as Im progressing my journey from NT to Linux it seems to be basic/handy knowledge for a *nix sysadmin to have, gonna buy book or something on the topic.
Both thanks for your help.
Btw for others: if you don`t want to store your downloaded documents (in my case they where 1mb each wget) don`t change the P to /dev/null/ since it will render your /dev/null to a normal file. Instead replace P to --output-document=/dev/null
|
|
| Back to top |
|
|
maypo.m
Joined: 22 May 2007
Posts: 1
|
| Posted: Tue May 22, 2007 7:05 pm Post subject: |
|
|
Thank you for the script mmealman.
I thought it would be useful - at least for me - to have it checks if the page is actually loading at all. At the moment it returns a $time value even if the connection to the host fails.
I'm not really a programmer but here below is my modified version of the original script. Before loading the page with wget I check if I can load the page with head. If that fails I set $time to a high value so I can set thold to alert me when the load time is above the threshold either because of a high load time or because it failed all together.
My 2 cents...
| Code: | #!/usr/bin/perl -w
use LWP::Simple;
$WGET = "/usr/bin/wget";
$TIME = "/usr/bin/time";
$host = $ARGV[0];
$url = $ARGV[1];
$uri="http://" . $host . $url;
$time = 0;
$check = "$TIME -p $WGET -T 30 -o tmp/tmp.log -p --no-cache -nd -O /dev/null " . $uri . " 2>&1";
if ( head($uri)) {
$results = `$check`;
if($results =~ m/\s*real\s+(\d+\.\d+)/) {
$time = $1;
} else {
$time = "Error";
}
}
else {
$time = 90;
}
print "avg: $time"; |
|
|
| Back to top |
|
|
sebbs
Cacti User
Joined: 22 Jan 2007
Posts: 78
Location: Ottawa,Canada
|
| Posted: Mon Jun 04, 2007 7:59 am Post subject: threshold/graphs |
|
|
Ok, so I added this web page load time into my graphs...all seems to work until I setup thresholds. IF load time goes over 1000 ms, it alerts....
So now I get every once and while i get "Reponse Time [avg] went above threshold of 1000 with 1253.38" , yet the graph cacti attaches to the email, shows nothing over a hundred....? i am lost. and if I check the graphs in cacti, it never hits 1000.
|
|
| Back to top |
|
|
senyahnoj
Joined: 28 Sep 2007
Posts: 2
|
| Posted: Thu Apr 17, 2008 6:37 am Post subject: |
|
|
Thanks for this most useful template.
Here is a PHP version if anyone is interested. Note that I've changed the wget options a little from the original (personal preference), and also the script cleans up the contents of /tmp/page_checks/ afterwards.
| Code: | #!/usr/local/bin/php -q
<?
$wget = '/usr/bin/wget';
if(isset($argv[1]) && isset($argv[2]))
{
$host = $argv[1];
$url = $argv[2];
}
else
{
exit;
}
$check = $wget . ' -T 30 -o /dev/null -nd -P /tmp/page_checks/ ' . $host . $url;
$start = microtime(true);
shell_exec($check);
$end = microtime(true);
exec('rm /tmp/page_checks/*');
echo 'avg:' . ($end - $start);
?>
|
|
|
| Back to top |
|
|
|
FAQ
Search
Memberlist
Register
Profile
Log in to check your private messages
Log in
