[Elastic Agent] Overwrite global processor settings about elastic-agent HOT 11 CLOSED

@kvch these are turned on by default by filebeat/metricbeat
agent does not modify default behavioud just output specific one, so if you need to get rid of these, just comment out processors section in data/install/filebeat-xyz/filebeat.yml and respective metricbeat config.

@ruflin if we want to tweak these we need to make sure these options are reloadable on the beats side and then work on providing global config options to beats

from elastic-agent.

Pinging @elastic/ingest-management (Team:Ingest Management)

from elastic-agent.

@michalpristas Could you have a look?

from elastic-agent.

@ruflin This look like more like a bug to me, maybe we should disable global process by default?

from elastic-agent.

+1 on getting rid of global processors long term. But for now it also has a performance implication if the add_x_metadate processors are local or global. But thinking about it I'm a little on the fence here. Maybe it could be a feature in Fleet to select which kind of metadata we want to collect in addition.

from elastic-agent.

I would probably treat 1 by 1 to decide which one should be enabled or not. I guess docker is enabled by default as it checks if it runs on docker and if not, should be silent?

from elastic-agent.

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

from elastic-agent.

cc @ph should be included inside the V2 architecture.

from elastic-agent.

@jlind23 is this issue closed because the problem can now be tackled somehow or because it is decided that the global processors won't be overridden ?

The need for editing/configuring global settings of filebeat or metricbeat like processors (add_cloud_metadata issue) or kubernetes provider is still around.

from elastic-agent.

We have always had this tracked as part of the shipper project since that is the key dependency that allows us to implement this in an intuitive way https://github.com/elastic/ingest-dev/issues/2442

from elastic-agent.

Thanks @cmacknz

from elastic-agent.