Testing: use test logs to verify ingest pipeline about integrations HOT 7 CLOSED

I'm fine with this as a PoC, but in the longer run, wow about creating our own tool that can run inside an integration dir? Only minded to work on a single integration, able to run tests and also help on the development

Actually we a chat about it with @ruflin to use a dedicated tool that you can use in different repos (integrations, package-storage). I'm happy to follow this path as I'm not a fan of mage :)

from integrations.

@skh Shall I ask you to respond to this question?

Re 1: what modifications does Kibana apply to the ingest pipeline? Let's say I need to apply same modifications and install the pipeline in ES manually.

from integrations.

IngestManager / EPM replaces '{{IngestPipeline "some-pipeline" }}' with "PACKAGEPREFIX-some-pipeline".

PACKAGEPREFIX will look like: "logs-PACKAGE.DATASET-VERSION".

We rename all pipelines before installation by prefixing them with PACKAGEPREFIX so the name of the referenced pipeline matches.

from integrations.

Thank you, @skh !

from integrations.

From my experience, mage is not a great tool for this for the following reason: mage belongs in a main directory, so you need to run it form there, because of that, you add parameters to tell mage what integration to look into. The list of parameters tends to grow and it is not really usable, as they are not passed as flags that you can document.

I'm fine with this as a PoC, but in the longer run, wow about creating our own tool that can run inside an integration dir? Only minded to work on a single integration, able to run tests and also help on the development

from integrations.

I assume your step 3 will get a bit more complex. It will require the agent to be run with the stream template and fill in the config variables, as otherwise you will not know how to read and process the log locally. This is basically the code in https://github.com/elastic/beats/blob/master/filebeat/tests/system/test_modules.py but finally implemented in Golang.

from integrations.

I think we have a plan for this so resolving.

from integrations.