Git Product home page Git Product logo

elk-config's Introduction

Aerokube ELK Stack Configs

This repository contains example configuration files used to send logs from Aerokube products to Elastic stack. We are using:

Quick Start Guide

  1. We assume here that you have two Linux hosts: first with Selenoid or Ggr (application host) and second where logs will be stored (ELK host).

  2. On application host go to beats directory and start Filebeat with Docker Compose:

$ cd beats
$ docker-compose up -d
  1. On the ELK host go to elk directory and start ELK stack with Docker compose:
$ cd elk
$ docker-compose up -d

elk-config's People

Contributors

vania-pooh avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

elk-config's Issues

Unable to connect to Elasticsearch at http://127.0.0.1:9200

Hi, I'm getting this error with this docker-compose

version: '3'

networks:
  elk:

volumes:
  elasticsearch:
    driver: local

services:

  elasticsearch:
    environment:
      http.host: 0.0.0.0
      transport.host: 127.0.0.1
#      network.host: 127.0.0.1
    image: docker.elastic.co/elasticsearch/elasticsearch:6.2.1
    networks:
      elk: null
    ports:
    - 9200:9200
    restart: unless-stopped
    labels:
      traefik.port: 9200
      traefik.frontend.rule: "PathPrefixStrip:/elasticsearch"
    volumes:
    - elasticsearch:/usr/share/elasticsearch/data:rw

  logstash:
    image: docker.elastic.co/logstash/logstash-oss:6.2.1
    depends_on:
      - elasticsearch
    networks:
      elk: null
    ports:
      - 5044:5044
    expose:
      - 5044
    restart: unless-stopped
    labels:
      traefik.port: 5044
      traefik.frontend.rule: "PathPrefixStrip:/logstash"
    volumes:
    - ./etc/logstash/pipeline:/usr/share/logstash/pipeline:ro

  kibana:
    depends_on:
    - elasticsearch
    environment:
      ELASTICSEARCH_PASSWORD: changeme
      ELASTICSEARCH_URL: http://127.0.0.1:9200 #http://elasticsearch:9200
      ELASTICSEARCH_USERNAME: elastic
    image: docker.elastic.co/kibana/kibana-oss:6.2.1
    networks:
      elk: null
    ports:
    - 5601:5601
    restart: unless-stopped
    labels:
      traefik.port: 5601
      traefik.frontend.rule: "PathPrefixStrip:/kibana" 

in log I see

kibana_1         | {"type":"log","@timestamp":"2018-09-30T09:50:46Z","tags":["warning","elasticsearch","admin"],"pid":1,"message":"Unable to revive connection: http://127.0.0.1:9200/"}
kibana_1         | {"type":"log","@timestamp":"2018-09-30T09:50:46Z","tags":["warning","elasticsearch","admin"],"pid":1,"message":"No living connections"}

 [2018-09-30T09:54:05,306][INFO ][logstash.outputs.elasticsearch] Running health check to see if an Elasticsearch connection is working {:healthcheck_url=>http://127.0.0.1:9200/, :path=>"/"}
logstash_1       | [2018-09-30T09:54:05,329][WARN ][logstash.outputs.elasticsearch] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://127.0.0.1:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://127.0.0.1:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

but elasticsearch is living and listening on port 9200

root@xxx-desktop ~# curl -XGET 'http://127.0.0.1:9200'
{
  "name" : "ZR9lm3A",
  "cluster_name" : "docker-cluster",
  "cluster_uuid" : "gxtM77LHSjOCy-otZeIhOw",
  "version" : {
    "number" : "6.2.1",
    "build_hash" : "7299dc3",
    "build_date" : "2018-02-07T19:34:26.990113Z",
    "build_snapshot" : false,
    "lucene_version" : "7.2.1",
    "minimum_wire_compatibility_version" : "5.6.0",
    "minimum_index_compatibility_version" : "5.0.0"
  },
  "tagline" : "You Know, for Search"
}

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.