Git Product home page Git Product logo

riemann-boshrelease's Introduction

BOSH release to run Riemann

Background

What is Riemann?

Riemann aggregates events from your servers and applications with a powerful stream processing language. Send an email for every exception in your app. Track the latency distribution of your web app. See the top processes on any host, by memory and CPU. Combine statistics from every Riak node in your cluster and forward to Graphite. Track user activity from second to second.

Usage

To use this bosh release, first upload it to your bosh:

bosh upload release https://github.com/hybris/riemann-boshrelease

For bosh-lite, you can quickly create a deployment manifest & deploy a cluster:

templates/make_manifest warden
bosh -n deploy

For AWS EC2, create a single VM:

templates/make_manifest aws-ec2
bosh -n deploy

Override security groups

For AWS & Openstack, the default deployment assumes there is a default security group. If you wish to use a different security group(s) then you can pass in additional configuration when running make_manifest above.

Create a file my-networking.yml:

---
networks:
  - name: riemann1
    type: dynamic
    cloud_properties:
      security_groups:
        - riemann

Where - riemann means you wish to use an existing security group called riemann.

You now suffix this file path to the make_manifest command:

templates/make_manifest openstack-nova my-networking.yml
bosh -n deploy

riemann-boshrelease's People

Contributors

abbi-gaurav avatar brewek avatar coteerichybris avatar joek avatar lnguyen avatar lpbedard avatar maksd avatar maltej avatar maxatsap avatar sebarys avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

riemann-boshrelease's Issues

Ability to emit fields as tags to InfluxDB

Hi there, we forked this release a while back to get things going quickly as we were still figuring out our metrics usage patterns in Concourse.

The main pattern we landed on was this:

For all metrics emitted, only use Riemann tags for things that we'd want to use for filtering in Riemann, and otherwise use custom fields for everything, as they're much more flexible (being key-value rather than an arbitrary array of strings).

We also had Riemann configured to do the following:

  • For every event, convert all custom fields to tags and send them off to InfluxDB.
  • For every event, convert all custom fields to key:value tag pairs and send them off to Datadog.

Our resulting config can be found here:

https://github.com/xoebus/riemann-boshrelease/blob/master/jobs/riemann/templates/config/riemann.config.erb

Looking back on your release now, while it does support configuring an InfluxDB host, it doesn't seem to do anything about custom fields and tagging. Our approach also is kind of hacky and relies on constructing a new InfluxDB client every time we receive an event, but I'm not sure which would be easiest to work with.

Does our metrics usage pattern align with yours? I wonder if that could just be the generic default, and the same thing could carry over if/when we do a pull request to support configuring Datadog.

Current riemann version (0.2.10) won't work with InfluxDb 0.13

Thanks for keeping this repo. I've been using it for my project and it is really helpful.

I had to change the version of the riemann binaries to 0.2.11 to make it work with our influxdb servers (v0.13).

Riemann version 0.2.10 will fail sending events to InfluxDb with error "database is required". See riemann/riemann#715

I would pull request my changes if only the change won't require uploading a new riemann blob. Please let me know if I can help in any way.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.