InfluxDB/Grafana/Bosun + Cacti = CereusTransport - Updated!

Addons for Cacti and discussion about those addons

Moderators: Moderators, Developers

Post Reply
Author
Message
brandstaetter
Posts: 4
Joined: Mon Jan 25, 2016 9:02 am
Location: Vienna/AUSTRIA

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#31 Post by brandstaetter » Tue Jan 26, 2016 7:35 am

Hi Phalek,

SQL error message has vanished now, but still no data in the influxDB.

Last log line in a poller cycle is:

Code: Select all

01/26/2016 12:03:31 PM - CereusTransporter: Poller[0] DEBUG: Adding [634] of data points for [imp-sr-sw1]
But imp-sr-sw1 is just the first one of the switches, I am polling.

execution exits at this line in setup.php:

Code: Select all

$newPoints = $database->writePoints($points, InfluxDB\Database::PRECISION_SECONDS);
I can e-mail the content of $points to you, if that helps.

greetings, Christian.

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#32 Post by phalek » Tue Jan 26, 2016 8:25 am

Yes please. [email protected]
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

Photovor
Posts: 3
Joined: Fri Jan 29, 2016 9:22 am

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#33 Post by Photovor » Fri Jan 29, 2016 9:27 am

I'm also having problems getting this to work on Cacti 0.8.8b and PIA 3.1. I uploaded it to the plugins folder, and installed and enabled it in the Plugin Management tab. I don't get any new setting tabs anywhere in the system for it, and my log file is showing this when the poller runs every 5 minutes:

01/29/2016 09:25:09 AM - CereusTransporter: Poller[0] ERROR: is not a valid scheme
01/29/2016 09:25:09 AM - CereusTransporter: Poller[0] INFO: Adding data to influxdb

I should be seeing some sort of settings tab somewhere for this plugin, right?

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#34 Post by phalek » Fri Jan 29, 2016 9:29 am

It's in the "MISC" settings tab.
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

Photovor
Posts: 3
Joined: Fri Jan 29, 2016 9:22 am

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#35 Post by Photovor » Fri Jan 29, 2016 9:56 am

phalek wrote:It's in the "MISC" settings tab.
I can't find a "MISC" settings tab anywhere in the system. Should this tab be under the Settings window under configuration?

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#36 Post by phalek » Fri Jan 29, 2016 10:02 am

It's in Console -> Settings -> misc
Attachments
screenshot.4.png
screenshot.4.png (145.83 KiB) Viewed 2757 times
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

Photovor
Posts: 3
Joined: Fri Jan 29, 2016 9:22 am

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#37 Post by Photovor » Fri Jan 29, 2016 10:11 am

I don't have that tab. I just have General, Paths, Poller, Graph Export, Visual, and Authentication. The Plugin Management screen says it's installed and enabled, and shows 'Active'.

EDIT:

I installed the Monitor plugin, and I got the Misc tab. Under that I now have the CereusTransporter Settings section. It would appear that the CereusTransporter plugin doesn't create or enable the Misc Tab by itself.

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#38 Post by phalek » Fri Jan 29, 2016 12:42 pm

Thanks,

Found the issue and fixed it. Will upload 0.49 soon.
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

shazxr
Posts: 16
Joined: Sun Apr 08, 2007 8:17 am

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#39 Post by shazxr » Mon Feb 01, 2016 2:08 am

HI,

Great work...

Am new to Grafana
data source added to grafana , But i need steps to create graph. kindly can you please share the steps

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#40 Post by phalek » Tue Feb 02, 2016 3:24 am

0.49 has been released, adding the missing "Misc" tab:

http://blog.network-outsourcing.de/prod ... ansporter/

theslim1 noted that he may write a short guide, but I assume it's quite time consuming doing so :-)
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

smcline06
Posts: 25
Joined: Mon Apr 22, 2013 1:30 pm

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#41 Post by smcline06 » Mon May 23, 2016 8:57 pm

Hey phalek, awesome plugin. Thank you so much for creating it!

I was wondering if you could share the metrics you are using to show interface data like your earlier screenshot? Or if you have a template I can load up and pick this data from :)

New to Grafana but finding it a bit difficult to pull multiple datasources from a single graph (using InfluxDB as back end).

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#42 Post by phalek » Tue May 24, 2016 2:45 am

I've added the sample dashboard I was using for download to this page:

https://www.urban-software.com/products ... ansporter/

It's by far not complete and I would really appreciate if someone can post their Dashboard for other to use as well.
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

smcline06
Posts: 25
Joined: Mon Apr 22, 2013 1:30 pm

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#43 Post by smcline06 » Tue May 24, 2016 10:12 pm

Thank you very much, and by the way awesome support on your site over the weekend getting that download link fixed +1

I will have some templates to shoot your in the next week, one thing I noticed is the Cacti device "description" does not appear to be sent to influxdb. I updated the following in setup.php but I know very little of php, wanted to make sure this isnt doing anything silly:

Before (Starting on Line 336):

Code: Select all

			$ds_info[ $ds_id ][ 'hostname' ]      = $ds[ 'hostname' ];		
			$host                                 = CereusTransporter_cleanTag( $db_type, CereusTransporter_host( $ds[ "hostname" ], $ds[ "description" ] ) );
			$ds_info[ $ds_id ][ 'host' ]          = strlen( $host ) > 0 ? $host : $ds[ 'hostname' ];
After (Starting on Line 336):

Code: Select all

			$ds_info[ $ds_id ][ 'hostname' ]      = $ds[ 'hostname' ];
			$ds_info[ $ds_id ][ 'description' ]   = $ds[ 'description' ];		
			$host                                 = CereusTransporter_cleanTag( $db_type, CereusTransporter_host( $ds[ "hostname" ], $ds[ "description" ] ) );
			$ds_info[ $ds_id ][ 'host' ]          = strlen( $host ) > 0 ? $host : $ds[ 'hostname' ];
I am now seeing it in test queries

> show series limit 1
key
host.mib.cpu.utilization,cacti_data_id=207,hostname=192.168.200.6,description=sc-wap-ac66u,host=192.168.200.6,host_type=Generic\ SNMP-enabled\ Host,metric_text=Host\ MIB\ -\ CPU\ Utilization,rate=gauge,namecache=sc-wap-ac66u\ -\ CPU\ Utilization\ -\ CPU0,type=cpu,units=percent

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#44 Post by phalek » Wed May 25, 2016 12:41 am

Hi smcline06

Thanks for that. I've added the line with some error checking ( InfluxDB only allows a very limited character range and the description may have others in it ( think of german umlauts or chinese chars ).

Updated to v0.50
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

User avatar
phalek
Cacti Guru User
Posts: 2711
Joined: Thu Jan 31, 2008 6:39 am
Location: Kressbronn, Germany
Contact:

Re: InfluxDB/Grafana/Bosun + Cacti = CereusTransport

#45 Post by phalek » Wed May 25, 2016 1:46 am

The next version will include the ability to send data to a Microsoft SQL Server (i.e. local system or on Azure )...
Greetings,
Phalek
---
Need more help ? Read the Cacti documentation or my new Cacti 1.x Book
Need on-site support ? Look here Cacti Workshop
Need professional Cacti support ? Look here CereusService
---
Plugins : CereusTransporter | CereusReporting | nmidWebService | nmidSmokeping | nmidWeb2 |

Code: Select all

CereusServer Master:  SYSTEM STATS: Time:2.5621 Method:spine Processes:1 Threads:16 Hosts:446 HostsPerProcess:446 DataSources:14683 RRDsProcessed:7573
CereusServer Agent:   SYSTEM STATS: Time:27.4840 Method:spine Processes:1 Threads:8 Hosts:16 HostsPerProcess:16 DataSources:114576 RRDsProcessed:48061
[/size]

Post Reply