input benthos_lab option multipart:false doesn't appear to make a difference about benthos-lab HOT 3 CLOSED

Hey @bkcsfi, right now you have two options:

• Input data is read as batches, where each line is a message of a batch, and you can insert blank lines between messages to split the batches
• Input data is read as a single message (containing all the content including line breaks)

It sounds like what you want can either be solved by inserting blank lines between each line (which is lame) or I can add a third option where each line is a single message batch, similar to the file and stdin inputs.

I'll mark this ticket as an enhancement for implementing the third option, but obviously I won't get mad if you just decide to add blank lines.

from benthos-lab.

Hi, thanks for the quick response.

I've watched all your videos and was using the labs version to setup a pipeline that can handle both plain text and json as input similar to your "intro to labs" video. It was confusing because the settings were set to "each line is a message".

Would it be clearer if this option was named "each line is a message in a multi-part batch" vs what I was really looking for which is "each line is a message in a single part batch".

Perhaps the phrasing is wrong, I'm still learning..

from benthos-lab.

Yeah I like that idea, I've I changed the names to try and make it clearer. We now have three options:

• each line is a message of a batch
• each line is a single message batch
• single message

Implemented: d7893fe
Released: https://github.com/benthosdev/benthos-lab/releases/tag/v0.7.1

Currently upgrading the production deployment.

from benthos-lab.