[RESOLVED] Does anyone have graphs working for NetApp qtrees

Templates, scripts for templates, scripts and requests for templates.

Moderators: Moderators, Developers

Author
Message
pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

[RESOLVED] Does anyone have graphs working for NetApp qtrees

#1 Post by pbratach » Thu Apr 20, 2006 10:06 am

Hello, I'm a newbie to cacti and am having trouble graphing NetApp qtrees. I've tried a few methods (using SNMP and running commands on the filer to generate an output file) but am unable to get any data onto a graph. In NetApp OnTAP 6.5, my data query finds all the qtrees, but only creates a few graphs and none of the graphs show anything other than 0 for the qtree usage and qtree limit. In NetApp OnTAP 7.0.2, my data query and snmpwalk only find 1 qtree and the graph only shows 0 for the qtree usage and limit. I've searched this forum for help but the only relevant post led to Bug 632 which did not resolve my problem (http://forums.cacti.net/viewtopic.php?t ... ight=qtree). I am able to see other graphs with valid data for both the filers running OnTAP 6.5 and 7.0, si I know I can get some SNMP data out of the filers.

I've attached my xml and templates and the cacti.log in DEBUG mode in the hopes that someone will find that I'm making a basic mistake that I as a newbie have overlooked.

Any help will be appreciated.

Thanks
Last edited by pbratach on Fri Apr 28, 2006 3:10 pm, edited 2 times in total.

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

#2 Post by gandalf » Sun Apr 23, 2006 2:28 pm

Please post an snmpwalk against .1.3.6.1.4.1.789.1.4.6.1
And please have a look at the very last link of my signature
Reinhard

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

#3 Post by pbratach » Mon Apr 24, 2006 10:52 am

Thanks for the reply, I did find and fix one 1problem, I had the wrong field name in the Assocaited Data Template entry in the Associated Graph Template screen. This now returns the value for the first qtree it finds on the NetApp filer.
I read through the last link in your signature, but am unable to decipher what entry I need for the HOST-DESCRIPTION-MIB. Here's the screenshot of what I tried:

pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 1 smeagol SNMPv2-SMI::qrV2Table
SNMPv2-SMI::qrV2Table: Unknown Object Identifier
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 1 smeagol SNMPv2-SMI::enterprises.qrV2Table
SNMPv2-SMI::enterprises.qrV2Table: Unknown Object Identifier (Sub-id not found: enterprises -> qrV2Table)
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 1 smeagol SNMPv2-SMI::enterprises::qrV2Table
SNMPv2-SMI::enterprises::qrV2Table: Unknown Object Identifier
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 1 smeagol SNMPv2-SMI.qrV2Table
SNMPv2-SMI.qrV2Table: Unknown Object Identifier (Sub-id not found: (top) -> SNMPv2-SMI)
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 2c smeagol SNMPv2-SMI::enterprises::qrV2Table
SNMPv2-SMI::enterprises::qrV2Table: Unknown Object Identifier
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 2c smeagol SNMPv2-SMI::qrV2Table
SNMPv2-SMI::qrV2Table: Unknown Object Identifier
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmptable -c public -v 2c smeagol SNMPv2-SMI::enterprises.qrV2Table
SNMPv2-SMI::enterprises.qrV2Table: Unknown Object Identifier (Sub-id not found: enterprises -> qrV2Table)


As you requested, I've attached an snmpwalk of the NetApp filer for the qtrees to this port. The netapp65.walk.txt file contains the walk for the filer running the NetApp OnTap version 6.5 OS. The netapp702.walk.txt file contains the walk for the filer running the NetApp OnTap version 7.0.2 OS.

Thanks for your help,
Paul
Attachments
netapp65.walk.txt.gz
(20.88 KiB) Downloaded 831 times
netapp702.walk.txt
(1.35 KiB) Downloaded 1220 times

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

#4 Post by gandalf » Mon Apr 24, 2006 12:43 pm

The netapp65 file is interesting.
The OID base seems to be SNMPv2-SMI::enterprises.789.1.4.6.1.1.
The Index seems to be a two-dimensional one, e.g.
1.1 - 1.8
2.1 - 2.4
...
14.1 - 14.34
There is some "interesting" data at SNMPv2-SMI::enterprises.789.1.4.6.1.5 and at SNMPv2-SMI::enterprises.789.1.4.6.1.8 (perhaps more following, did not check the whole file). Without MIBs, I don't know what those OIDs are displaying. This belongs to you.
But it is possible, to define a two-dimensional index for some SNMP Query XML file. If you'll sort out those OIDs you're interested in, together with their meanings, I'll guide you through the whole process. But as I do not have access to such a device, this may require some ping-pong between the two of us
Reinhard

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

#5 Post by pbratach » Tue Apr 25, 2006 3:05 pm

Hmm, that is interesting. The OID's I need are qrV2Tree (the name of the qtree at OID .1.3.6.1.4.1.789.1.4.6.1.14), qrV2LowKBytesUsed (.1.3.6.1.4.1.789.1.4.6.1.5) and qrV2LowKBytesLimit (.1.3.6.1.4.1.789.1.4.6.1.8). I asked our local Cacti expert about the two-dimensional index and he has no idea how to handle that. So I am including the netapp.mib file that contains a description of the MIB from NetApp and the traps.dat file which shows the OID for each MIB field name in hopes that will help resolve this issue. This is what I am currently seeing in my cacti.log file:

04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[981] WARNING: Result from SNMP not valid. Partial Result: ...
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[981] SNMP: v1: wormtongue, dsname: LowKBytesUsed, oid: .1.3.6.1.4.1.789.1.4.6.1.5.1, value: U
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[982] WARNING: Result from SNMP not valid. Partial Result: ...
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[982] SNMP: v1: wormtongue, dsname: LowKBytesUsed, oid: .1.3.6.1.4.1.789.1.4.6.1.5.6, value: U
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[981] WARNING: Result from SNMP not valid. Partial Result: ...
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[981] SNMP: v1: wormtongue, dsname: LowKBytesLimit, oid: .1.3.6.1.4.1.789.1.4.6.1.8.1, value: U
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[982] WARNING: Result from SNMP not valid. Partial Result: ...
04/25/2006 01:57:01 PM - CACTID: Poller[0] Host[8] DS[982] SNMP: v1: wormtongue, dsname: LowKBytesLimit, oid: .1.3.6.1.4.1.789.1.4.6.1.8.6, value: U

The OID for the LowKBytesUsed and LowKBytesLimit is missing the qrV2Volume number in in's OID...when I snmpwalk the OID .1.3.6.1.4.1.789.1.4.6.1.8.6 I get nothing, but when I snmpwalk the OID .1.3.6.1.4.1.789.1.4.6.1.8.2.6, I get the value I am looking for.

pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmpwalk -c public -v 1 wormtongue .1.3.6.1.4.1.789.1.4.6.1.8.6
pbratach @ AgentSmith
[/var/www/html/netapp/cacti]>snmpwalk -c public -v 1 wormtongue .1.3.6.1.4.1.789.1.4.6.1.8.2.6
SNMPv2-SMI::enterprises.789.1.4.6.1.8.2.6 = INTEGER: 20971520

So somehow I need to get the qrV2Volume number into the OID for the LowKBytesUsed and LowKBytesLimit fields, and that is what I am having trouble with.

Thanks,
Paul

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

#6 Post by pbratach » Tue Apr 25, 2006 4:09 pm

hear are the attachments.
Attachments
netapp.mib.txt.gz
(62.22 KiB) Downloaded 1154 times
traps.dat.txt
(142.28 KiB) Downloaded 2466 times

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

#7 Post by gandalf » Wed Apr 26, 2006 11:06 am

pbratach wrote:Hmm, that is interesting. The OID's I need are qrV2Tree (the name of the qtree at OID .1.3.6.1.4.1.789.1.4.6.1.14), qrV2LowKBytesUsed (.1.3.6.1.4.1.789.1.4.6.1.5) and qrV2LowKBytesLimit (.1.3.6.1.4.1.789.1.4.6.1.8). I asked our local Cacti expert about the two-dimensional index and he has no idea how to handle that.
Hehe, lets have a go. What you need is called an OID/REGEXP together with some <oid_index_parse>. You may search the docs and the forum for that. You should find some post (very recent ones should be found) describing this.
If in trouble, please post
Reinhard

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

#8 Post by pbratach » Thu Apr 27, 2006 3:40 pm

Reinhard,

well I'm getting closer, but still baffled about how to get the volume number into the OID for the LowKBytesUsed field. Here is the output from the Verbose Query in the Devices screen:

+ Running data query [16].
+ Found type = '3' [snmp query].
+ Found data query XML file at '/var/www/html/netapp/cacti-0.8.6h/resource/snmp_queries/netapp_qtrees.xml'
+ XML file parsed ok.
+ Executing SNMP walk for list of indexes @ '.1.3.6.1.4.1.789.1.4.6.1'
+ Located input field 'qrV2Index' [walk]
+ Executing SNMP walk for data @ '.1.3.6.1.4.1.789.1.4.6.1.1'
+ Found item [qrV2Index='1'] index: 2.1 [from value]
...
+ Located input field 'qrV2Volume' [walk]
+ Executing SNMP walk for data @ '.1.3.6.1.4.1.789.1.4.6.1.13'
+ Found item [qrV2Volume='2'] index: 2.1 [from value]
...
+ Located input field 'qrV2Tree' [walk]
+ Executing SNMP walk for data @ '.1.3.6.1.4.1.789.1.4.6.1.14'
+ Found item [qrV2Tree='at04_apps'] index: 2.1 [from value]

As you can see the qrV2Tree variable now has the two-dimensional area index that I need, where 2 is the volume number and 1 is the qtree number. But I don't know how to make my XML file use this index value to display the value of the OID .1.3.6.1.4.1.789.1.4.6.1.5.2.1 where 2.1 is the index I need added to the base OID 1.3.6.1.4.1.789.1.4.6.1.5.

Here's the XML file that I've modified since my earlier post that uses the OID/REGEXP (thanks for the suggestion):

<interface>
<name>Get Netapp qtree stats</name>
<oid_index>.1.3.6.1.4.1.789.1.4.6.1</oid_index>
<oid_index_parse>OID/REGEXP:.*\.([0-9]+\.[0-9]+)$</oid_index_parse>
<index_order>qrV2Tree</index_order>
<index_order_type>alphanumeric</index_order_type>
<index_title_format>|chosen_order_field|</index_title_format>
<fields>
<qrV2Index>
<name>Index</name>
<method>walk</method>
<source>value</source>
<direction>input</direction>
<oid>.1.3.6.1.4.1.789.1.4.6.1.1</oid>
</qrV2Index>
<qrV2Volume>
<name>Volume</name>
<method>walk</method>
<source>value</source>
<direction>input</direction>
<oid>.1.3.6.1.4.1.789.1.4.6.1.13</oid>
</qrV2Volume>
<qrV2Tree>
<name>Tree</name>
<method>walk</method>
<source>value</source>
<direction>input</direction>
<oid>.1.3.6.1.4.1.789.1.4.6.1.14</oid>
</qrV2Tree>
...
<qrV2LowKBytesUsed>
<name>LowKBytesUsed</name>
<method>walk</method>
<source>index</source>
<direction>output</direction>
<oid>.1.3.6.1.4.1.789.1.4.6.1.5</oid>
</qrV2LowKBytesUsed>
...
<qrV2LowKBytesLimit>
<name>LowKBytesLimit</name>
<method>walk</method>
<source>index</source>
<direction>output</direction>
<oid>.1.3.6.1.4.1.789.1.4.6.1.8</oid>
</qrV2LowKBytesLimit>

I've set the source on the qrV2LowKBytesUsed field to index, according to the docs, but I still am unable to get the graph created.

Thanks,
Paul

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

javascript:emoticon(':D')RESOLVED!!!

#9 Post by pbratach » Fri Apr 28, 2006 10:05 am

Reinhard,

Thank you very much for all of your help, it was a long and grueling 3 weeks, but it feels good to have completed this task. Looking over my XML again this morning, I discovered that I had the wrong OID for the qrV2Volume. When I corrected the OID, I was able to create the qtree graphs (all 288 of them on one of our filers). Now I will go ahead and create them for our remaining filers and see what that does to the performance of our cacti server. I will post all my templates and XML later today for anyone who is interested in graphing NetApp qtrees.

Paul

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

#10 Post by pbratach » Fri Apr 28, 2006 3:18 pm

As promised, here's the XML and template files for NetApp OnTAP 6.5 that work for qtrees. These graphs will only work with 32 bit counters, so any qtree or volume over 4TB will not graph properly. We only have 1 qtree and volume that big right, now, so it's not high on my list to make this work for 64 bit counters. But that will happen soon I'm sure.

See my next post for the 7.0.2 templates and xml file.
Attachments
netapp_qtrees.xml
This is the xml file for OnTap 6.5
(2.86 KiB) Downloaded 1048 times
cacti_data_query_netapp_dq_qt_32.xml
This is the data query template for OnTap 6.5
(16.16 KiB) Downloaded 957 times
cacti_data_template_netapp_dt_qt_32.xml
This is the data template for OnTap 6.5
(7.14 KiB) Downloaded 910 times
cacti_graph_template_netapp_gt_qt_32a.xml
This is the graph template for OnTap 6.5
(14.42 KiB) Downloaded 1213 times
Last edited by pbratach on Fri Apr 28, 2006 3:32 pm, edited 1 time in total.

pbratach
Posts: 12
Joined: Fri Apr 14, 2006 4:13 pm

#11 Post by pbratach » Fri Apr 28, 2006 3:22 pm

Here's the templates and xml file for NetApp OnTap 7.0.2. Please note. I had to use deprecated OID's in OnTAP 7.0.2 to generate the qtree graphs. Also, I had to increase the size of the Maximum Field Length and Maximum Title Length to 50 characters to fit in the whole qtree name.
Attachments
netapp_qtrees7g.xml
This is the xml file for OnTap 7.0.2
(1.15 KiB) Downloaded 1321 times
cacti_data_query_netapp_dq_qt_32_7g.xml
This is the data query for OnTap 7.0.2
(16.16 KiB) Downloaded 1445 times
cacti_data_template_netapp_dt_qt_32_7g.xml
This is the data template for OnTap 7.0.2
(7.13 KiB) Downloaded 1117 times
cacti_graph_template_netapp_gt_qt_32a_7g.xml
This is the graph template for OnTap 7.0.2
(14.41 KiB) Downloaded 1472 times

User avatar
gandalf
Developer
Posts: 22375
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

#12 Post by gandalf » Sat Apr 29, 2006 6:38 am

Very well done.
Now moving to Scripts and Templates for others to find them in the correct location
Reinhard

User avatar
wwwdrich
Cacti User
Posts: 91
Joined: Thu Feb 03, 2005 5:53 pm
Location: San Jose, CA
Contact:

#13 Post by wwwdrich » Mon May 01, 2006 3:04 pm

pbratach wrote:Here's the templates and xml file for NetApp OnTap 7.0.2. Please note. I had to use deprecated OID's in OnTAP 7.0.2 to generate the qtree graphs. Also, I had to increase the size of the Maximum Field Length and Maximum Title Length to 50 characters to fit in the whole qtree name.
I think those "depreciated" OIDs have gone away as of 7.0.4. There's nothing under enterprises.789.1.4.3.1 in 7.0.4, however, enterprises.789.1.4.6.1 is still fine.

Any thoughts?
- Dan
[i] "Step up to red alert!" "Are you sure, sir?[/i]
[i] It means changing the bulb in the sign..." - Red Dwarf[/i]

xian_yangyq
Posts: 16
Joined: Sun Apr 09, 2006 9:29 pm

#14 Post by xian_yangyq » Tue Jun 06, 2006 4:30 am

I have NETAPP:RELEASE:7.1 need graphs for cacti, we should use which XML file??

User avatar
AndyStewart
Cacti User
Posts: 102
Joined: Thu Sep 29, 2005 5:21 am
Location: Edinburgh, Scotland

#15 Post by AndyStewart » Tue Jun 06, 2006 4:43 am

I don't care if the glass is half full or half empty, i want to know, who's been drinking my pint!!!

[size=75][Windows 2003 & IIS6] [Cacti 0.8.7b] [ActivePerl 5.8.8.817] [MySql 5.0.19] [NetSNMP 5.2.1.2-1] [PHP 5.1.2] [RRDTool 1.2.11]
[Plugins: PluginArchitecture, Monitor, Discovery, Threshold, Update, Reports, Manage, RealTime][/size]

Post Reply