Comments (5)
Fanout queues are not supported now, but it's fairly easy to add this feature.
However, I'm working on "multiple consumer groups" feature and it's almost done.
You can check v0.5 branch. The idea is to be able to read any queue multiple times.
Usage: get <queue>:<consumer_group>
get work:my_consumer_group
get work:1
It will create a consumer group or durable cusor so you can read the source queue multiple times. It's lightweight and doesn't multiply disk space usage.
What is your fanout queues use case?
Is it really complex? or you can get benefit from multiple consumer groups feature?
from siberite.
We use fanouts for different purpose; given a base queue named messages:
- test: fetch messages with a test/pre-production sw messages+TEST
- backup: messages+WEEKLY_BACKUP
- fetch with multiple sw component same data: messages+product_1, messages+product_2
We are a java-shop and we use memcached client to access Kestrel servers. We have some clients written in c#.
If you implement fanouts, siberite could be a replacement for kestrel as is. If consumer group is only a suffix for the queue's name, it's quite the same. I don't understand how can you consider expired an item in the queue, because you can't know how many clients are part of the group.
from siberite.
I don't understand how can you consider expired an item in the queue, because you can't know how many clients are part of the group.
- When you read an item in a usual way:
get messages
, an item gets expired and deleted. - When you read an item using consumer group:
get messages:cgroup
, a durable cursorcgroup
gets initialized and with every read it shifts forward without deleting any messages in the source queue. So the source queue remains untouched. Number of consumer groups per queue is not limited. - You can start reading from the source queue directly again and it will start deleting messages. Any existing consumer group cursor that internally points to already deleted message will catch up and will start serving messages from the current source queue head.
Maybe consumer group term is confusing and I should start using durable cursor instead.
PS. I will add fanout queues support to the roadmap.
The implementation is pretty much straightforward.
from siberite.
Ok, fanout are different. Yes, open a fanout will double the space, but it allows to fetch from main o fanouts independently.
Thank you very much for your support.`
from siberite.
They are supported now.
from siberite.
Related Issues (7)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from siberite.