Fluentd-Elasticsearch helm chart about fluent-plugin-aws-elasticsearch-service HOT 7 CLOSED

Do I need to add something to the configmap that the chart create in order for fluentd to use the role assigned to the pod?

fluentd-elasticsearch daemonset does not sign its request.
This is because unable to push events into AWS Elasticsearch Serivce via fluentd-elasticsearch.

from fluent-plugin-aws-elasticsearch-service.

@cosmo0920 what steps would one need to do to get THIS plugin to work with the helm chart (stable helm charts) located here: https://github.com/kiwigrid/helm-charts/tree/master/charts/fluentd-elasticsearch ?

do you have suggestions on this ?

from fluent-plugin-aws-elasticsearch-service.

Again, fluent-plugin-elasticsearch cannot handle AWS required sigv4 requests.
If users want to send events into AWS Elasticsearch Service, we should create fluent-plugin-aws-elasticsearch-service deamonset support first.
Because fluent-plugin-elasticsearch and fluent-plugin-aws-elasticsearch-service plugins are different plugin.
(@type elasticsearch calls fluent-plugin-elasticsearch not fluent-plugin-aws-elasticsearch-service)
Then, request AWS Elasticsearch service support in helm chart.

from fluent-plugin-aws-elasticsearch-service.

@cosmo0920 its clear it cannot handle that.. thanks again for clarification.

My question is how to resolve. As this is not exactly a rare use case.

I'm asking for the next steps to get AWS support .. in that helm chart..

you're saying we need:

1. "we should create fluent-plugin-aws-elasticsearch-service deamonset support first."
   --- who is we?
   --- what is level of effort?
2. request AWS Elasticsearch service support in helm chart.

are there other steps to do this? I appreciate your response

from fluent-plugin-aws-elasticsearch-service.

1. "we should create fluent-plugin-aws-elasticsearch-service deamonset support first."
   --- who is we?

Someone who wants to create it. Perhaps, including you.

   --- what is level of effort?

I have no idea. I'm not familiar with creating helm chart from scratch.

2. request AWS Elasticsearch service support in helm chart.

helm chart is maintained in the other repository. Someone who wants to add AWS ES service charts should send a PR to support it.

from fluent-plugin-aws-elasticsearch-service.

Check this fluent/fluentd-kubernetes-daemonset#317

from fluent-plugin-aws-elasticsearch-service.

Check:

• https://hub.helm.sh/charts/kiwigrid/fluentd-elasticsearch

fluentd-elasticsearch helm chart now support this with sidecar AWS signer proxy container.

from fluent-plugin-aws-elasticsearch-service.