Kafkabeat is an elastic Beat that reads events from one or more Kafka topics and forwards them to Logstash (or any other configured output).

The Kafka consumer implements an at-least-once behaviour which means that messages may be forwarded to the configured output more than once.

• Golang 1.7

# Make sure $GOPATH is set
go get github.com/justsocialapps/kafkabeat
cd $GOPATH/src/github.com/justsocialapps/kafkabeat
make

To run Kafkabeat with debugging output enabled, run:

./kafkabeat -c kafkabeat.yml -e -d "*"

An example configuration can be found in the file kafkabeat.yml. The following parameters are specific to Kafkabeat:

kafkabeat:
    # a list of Kafka brokers to connect to
    brokers: ["localhost:9092"]
    # A list of topics to subscribe to
    topics: ["tracking"]
    # The consumer group to join
    group: "kafkabeat"

To test Kafkabeat, run the following command:

make testsuite

alternatively:

make unit-tests
make system-tests
make integration-tests
make coverage-report

The test coverage is reported in the folder ./build/coverage/