Git Product home page Git Product logo

Comments (11)

dwoo4dwoo avatar dwoo4dwoo commented on August 17, 2024 1

@repeatedly - what would you think of extending uken/fluent-plugin-elasticsearch to support Amazon signing? Amazon signing seems to be the biggest (only?) feature lacking in uken/fluent-plugin-elasticsearch?

from fluent-plugin-aws-elasticsearch-service.

repeatedly avatar repeatedly commented on August 17, 2024 1

If someone wants to merge this feature into ES plugin, new active maintainer for AWS ES parts is needed.
But I think forking this project is better. ES can focus on ES feature, not transport.

from fluent-plugin-aws-elasticsearch-service.

aibou avatar aibou commented on August 17, 2024

How about using the Amazon Kinesis Firehose instead?
I have stopped using this plugin and started using it and https://github.com/awslabs/aws-fluent-plugin-kinesis because I had trouble as #25 and it seems there is no future to resolve it.

However, the Firehose outputs to the ES domains only same region, then this idea can apply in us-east-1, us-west-2, eu-west-1 regions :(
Although I always use ap-northeast-1, I created ES domains in us-west-2.

from fluent-plugin-aws-elasticsearch-service.

mpas avatar mpas commented on August 17, 2024

I am also running into issues using this plugin. Any good recommendation as an alternative? I looked at putting the logs into cloudwatch and stream to ES. But this is a very costly approach.

from fluent-plugin-aws-elasticsearch-service.

repeatedly avatar repeatedly commented on August 17, 2024

There are 2 approaches:

  • someone becomes new maintainer if @atomita is ok
    • option is fluent-plugins-nursery for temporal place
  • fork plugin (I don't want to do)

from fluent-plugin-aws-elasticsearch-service.

yissachar avatar yissachar commented on August 17, 2024

This plugin is small enough that rolling functionality into fluent-plugin-elasticsearch makes a lot of sense. On the other hand that plugin is not well-maintained either these days.

from fluent-plugin-aws-elasticsearch-service.

repeatedly avatar repeatedly commented on August 17, 2024

I'm not sure because I'm not a maintainer of elasticsearch plugin.
If the elasticsearch maintainers and contributors are okay, it is good idea.

from fluent-plugin-aws-elasticsearch-service.

dwoo4dwoo avatar dwoo4dwoo commented on August 17, 2024

On the other hand that plugin is not well-maintained either these days.

@yissachar - yeah, I thought this was being resolved in uken/fluent-plugin-elasticsearch#240, in particular that @repeatedly was being given access. I just re-read that PR now and it still seems unresolved. This is a real bummer because for many people, myself included, Fluentd loses a lot of value without a good well maintained Elasticsearch plugin.

from fluent-plugin-aws-elasticsearch-service.

Nossnevs avatar Nossnevs commented on August 17, 2024

@cosmo0920 are you interested to merge this plugins functionality in to uken/fluent-plugin-elasticsearch ?
@atomita are you good with this and let this plugin die?

from fluent-plugin-aws-elasticsearch-service.

cosmo0920 avatar cosmo0920 commented on August 17, 2024

No. I'm not familiar with AWS Elasticsearch Service.

from fluent-plugin-aws-elasticsearch-service.

cosmo0920 avatar cosmo0920 commented on August 17, 2024

I'd became an active maintainer. (But still @atomita wants to publish this plugin by his own.)
So, we can close this issue.

from fluent-plugin-aws-elasticsearch-service.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.