Munin to InfluxDB+Grafana gateway

Tool to migrate smoothly from Munin (RRD) to InfluxDB and Grafana dashboards.

Provide two commands:

• import
  • Import existing Munin data to InfluxDB (groups fields in the same series by default).
  • Generate a Grafana dashboard based on the existing Munin configuration.
  • Creates a cronjob to run the fetch command.
• fetch
  • Update InfluxDB with fresh data from a still running Munin service

Data from Munin RRD databases are combined and imported into an InfluxDB cluster (version 0.10 and later).

Munin fields from a same plugin are grouped as columns of the same InfluxDB time series.

Grafana layout settings are imported from Munin plugin's configuration. Supported elements:

• Min, max, average and current values in legend table
• Line, area, stacked metrics
• Warning, critical thresholds
• Graph orders
• Aliases
• Tooltip overlays
• Metrics colors
• Multigraphs (partial support)

1. Via Pypi:

   $ pip install munin-influxdb
   

2. Or the repository

   $ git clone https://github.com/mvonthron/munin-influxdb.git
   $ sudo python setup.py install
   

3. Run import command:

$ sudo ./muninflux import

4. A cron job will be automatically added after installation to refresh data from munin every 5 minutes (Munin default)

• About importing current data

Munin stores data in a number of ways: the main storage is RRD databases, but we also have access to the cache of HTML webpages, config files and fresh data storage (see below). munin-influxdb reads the htmlconf.storable file to discover the plugins to extract and some of their settings (legend, thresholds...). The RRD databases (where the data history is kept) are then extracted to XML (because reading RRD's native format is even worse than parsing XML), parsed, and uploaded to InfluxDB. Then the information extracted from the htmlconf files are used to help generate a Grafana dashboard linked to the new InfluxDB storage.

• About fetching new data

Fresh data is not obtain from the RRD databases but from Munin's storable files. This is a Perl specific format where Munin stores the two latest values for each metric.

This program and its documentation are released under the terms of the BSD license.

2016, Manuel Vonthron [email protected]