Comments (10)
The latest package should support v0.9.0 through v0.10.1
from kafunk.
The version targeted is 0.9. Plan to do a nuget release once the internal routing mechanism in the Kafka connection is completed.
from kafunk.
Hey, just FYI, I made some good progress on my branch (https://github.com/eulerfx/kafunk). You can go take it for a spin if you'd like. I was mostly focusing on getting the consumers working, with rebalancing, etc.
Some things remaining:
- Going through broker list when broker is unavailable (right now, it will keep retrying with the same one, and eventually fail).
- Complete configuration (some things are implicitly configured).
- Bring in Logary (I didn't have it on my branch yet and I changed all of the logging, but would like to bring back Logary).
- Externalize AsyncSeq (will take a slight bit of effort as the framing code relies on the linked list representation; the framing code however needs to be refactored a bit anyway).
Supporting 0.10 shouldn't be too hard, it just added a couple of fields in a few of the APIs.
from kafunk.
Hi @eulerfx and thanks for the update. Unfortunately it was off my time schedule when you sent the update; so I hope to circle back to try your code in a few weeks.
from kafunk.
Next opportunity for me to try this code is tomorrow and Wednesday as a part of https://github.com/haf/linux-intro-course/tree/master/chapter-04. If kafunk supports 0.10 of Kafka by Wednesday, the tutorial will use it, otherwise RdKafka.
from kafunk.
@haf: cool! Not quite sure we will support 0.10 entirely by then (currently fully supporting 0.9 and some 0.10). But, the current master is in a working state. We've been running it internally and will be releasing components using it into production this month. Will publish nuget sometime this week, we just have to bring back some of the logging changes you pushed.
from kafunk.
Could you make a list of features not supported from v0.10, please? And perhaps even publish a nuget with the current state as well?
from kafunk.
Here's an alpha package:
https://www.nuget.org/packages/Kafunk/0.0.7-alpha001
It currently logs to stdout. You can control verbosity though, and it doesn't emit trace by default.
Re v0.10, I took a quick look, and I think its safe to assume none of the things new in v0.10 are supported. Looks like we started on it (added ThrottleTime field to ProduceResponse), but incomplete.
from kafunk.
This should be the list of things for v0.10: #77
from kafunk.
OK, so it looks like there isn't much left to get v0.10.0 supported. I've a POC on my fork (https://github.com/eulerfx/kafunk). I'll test it over the next couple of days.
from kafunk.
Related Issues (20)
- ACL
- Fault tolerance hierarchies
- Add default Partitioner to the producer emulating Java client
- Error messages in the consumer
- Consumer fails to commit offset periodically after partition rebalance event
- Consumer randomly stops consuming, but continues to commit the stagnant offsets. HOT 2
- Add a count to ProducerResult
- Escalate codec exceptions without retry HOT 1
- MessageTooBigException when consuming a Snappy compressed topic.
- Request adding a consume function readToOffsets HOT 1
- Review log severity levels to prevent false positives HOT 1
- Kafka Crash Cource should be "Course" HOT 2
- Support for v0.11 protocol HOT 1
- Consumer shouldn't fail when no partitions are assigned. HOT 1
- Consumer slow when using autoVersions=true
- Snappy unit tests fail on .net Core HOT 1
- Can we update the Readme?
- Consumer does not recover from leaderless partition HOT 2
- Transaction support
- What are the advantages of Kafunk over the .NET wrapper of librdkafka? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kafunk.