Comments (7)
👍 sounds good! Plrease reopen the issue if this isn't worked, I think this is closed.
from franz-go.
There is a function, RetryBackoffFn
. The default strategy is to start at 100ms and exponentially backoff with jitter to 1s (this mirrors the behavior described in KIP-144).
I think the timestamp resolution in your logs may not be fine grained enough -- try adding milliseconds with .999
if this is from time.Format.
I'd be opening to changing the default backoff to 250ms rather than 100, and bumping the max backoff to 2.5s or 5s, though. Let me know if upping the time format resolution shows some backoff?
from franz-go.
wow, nice. if i want to not timeout retries and retry always what params i need to specify ?
my use-case if service start consuming and connection broken - retry forever
from franz-go.
Is this for producing, or general admin requests?
Producing already has unlimited retries by default, with acks == -1.
Admin requests have a 1min timeout. I recommend keeping that, but there does exist a RetryTimeout option.
from franz-go.
this question for consuming. so i'm run client.PollFetches and want it connection is dies - auto reconnect to kafka brokers and continue fetching.
from franz-go.
That's the default behavior already, and I think that's the behavior for any client. Any kafka client should continue to reconnect for fetching (with some backoff)
from franz-go.
ok fine, now experimenting with backoff, thanks
from franz-go.
Related Issues (20)
- Retry fetched records on handle error HOT 1
- github.com/twmb/franz-go/pkg/sr#Client.AllSchemas 404 not found HOT 3
- Deadlock in Produce() / TryProduce() when kgo.MaxBufferedBytes() is configured HOT 2
- Unable to specify LZ4 compression level HOT 3
- Error on kadm/UserSCRAMs calls with redpanda HOT 3
- Question: Is it safe to poll after receiving ErrGroupSession on poll when a broker node restarts in the cluster? HOT 1
- Data Race: concurrent access to recBatch.canFailFromLoadErrs during retry errors HOT 4
- Is there a way to test kgo.Opts returned from wrapper function? HOT 1
- fetch using topic id HOT 3
- How to delete offset when message got consumed? HOT 4
- Imbalanced Partition Assignment to Consumers Per Topic HOT 1
- Want to delete the consumer group after processing records from kafka HOT 1
- Connecting franz-go with a confluent kafka cloud cluster HOT 2
- Decoding GroupMetadataValueMember fails HOT 1
- Cache metadata more HOT 1
- Question regarding manual commit example HOT 1
- Update GroupMetadataKey / GroupMetadataValue
- Bump epoch if the log_start_offset advanced and broker returned unknown_producer_id
- kgo.LiveProduceConnection option for low-latency settings HOT 4
- BrokerResponse too large HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from franz-go.