Kafka .9 plugin about fluent-plugin-kafka HOT 22 CLOSED

I'm now working on replace poseidon with ruby-kafka to support v0.9.

from fluent-plugin-kafka.

kafka_buffered output have already supported kafka v0.9 and v0.10.
Does anyone need to support kafka v0.9 or v0.10 with input plugins?

from fluent-plugin-kafka.

This plugin should support Kafka 0.9 also, and it can work with 0.9.
Regarding to Kerberos, this plugin doesn't support yet. let me think about it. thanks,

from fluent-plugin-kafka.

is there a branch for that upgrade to ruby-kafka?

from fluent-plugin-kafka.

any date for 0.9 release? trying to use it with mapr streams (0.9 api ) but having problems fetching metadata from broker (for sure is the api version )

thanks mate!

from fluent-plugin-kafka.

Hi @repeatedly, any update on the migration to ruby-kafka, is there a branch for it ?
Would be happy to help if I can

from fluent-plugin-kafka.

0.10 is being released
https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+0.10.0

from fluent-plugin-kafka.

nice, so that version will be 0.9 kafka api compliance right? its not clear for me in the content included.

thanks!

from fluent-plugin-kafka.

Sorry for the delay. I opened a PR here: #54

from fluent-plugin-kafka.

thank you @repeatedly !!

from fluent-plugin-kafka.

I'd love to see Kafka 0.9 input supported, along with SSL capabilities. I'm guessing the Zookeeper config option would be dropped given that 0.9 consumer doesn't need to talk to ZK.

The ability to read a topic from the beginning would be even better, but that's for another day :)

from fluent-plugin-kafka.

Actually I need v0.10 support with input plugins.

from fluent-plugin-kafka.

@repeatedly I need the kafka v0.9 support with input plugins.

from fluent-plugin-kafka.

I wrote a patch for input plugins.
Please test: #64

from fluent-plugin-kafka.

@repeatedly I tested this plugin with Kafka 0.10.0 as Kafka consumer. Input plugin (@type 'kafka' and @type 'kafka_group') are working well in my environment.

from fluent-plugin-kafka.

@kentarosasaki Thanks for testing!

Does anyone also test the patch?
If there is no problem, I will merge the patch and release fluent-plugi-kafka v0.3.0-dev.1

from fluent-plugin-kafka.

I released fluent-plugin-kafka v0.3.0.rc1 for testing.
You can install this version with --pre option.
Please check it on your environment before release v0.3.0.

from fluent-plugin-kafka.

@repeatedly I've tested v0.3.0.rc1 which was installed by using --pre option. It's also working fine on my environment.

from fluent-plugin-kafka.

Thanks for the test again!

I need more tester :)

from fluent-plugin-kafka.

@repeatedly fwiw, I've been testing v0.3.0.rc1 today and everything looks good. I'll keep it in pre-production testing for the next few weeks.

from fluent-plugin-kafka.

@hmmbug thanks for the testing!

from fluent-plugin-kafka.

I will release fluent-plugin-kafka v0.3.0 in the end of this week.

from fluent-plugin-kafka.