Demonstrate Centralised Logging with EFK stack (Elasticsearch Fluentd Kibana). The whole stack and the demo app can be run locally using docker-compose
The related presentation can be found here
# Running for the first time
$ cd efk/
$ docker-compose up -d
# Check if everything is running
$ docker-compose ps
# See the logs
$ docker-compose logs -f
# Stopping Everything
$ docker-compose stop
# Start it up again
$ docker-compose start
# Tear down
$ docker-compose down -v
Demo app that log in traditional text format
Demo app that log in JSON format
# Running for the first time
$ cd structured/ # or traditional/
$ docker-compose up -d
# Scaling in and out
$ docker-compose scale processor=10
$ docker-compose scale processor=1
- Edit
efk/fluent/config/fluent.conf
- While inside
efk/
directory. Rundocker-compose restart fluentd
- Edit
main.py
in the app directory - While inside app directory. Run
docker-compose restart