goeswind / consumer-dispatcher Goto Github PK

#The Consumer Dispatcher Project

Consumer Dispatcher works as a proxy between RabbitMQ and your consumers. Let you scale out and maintain consumers easily.

It provides:

• managing consumers of different queues separately
• serving queues for multiple sites with one instance
• avoid blocking consuming queues
• adding/reducing number of consumers on the fly by clicking a button
• load balance between consumers
• purging queues by clicking a button
• separating bad jobs from good ones in a queue and logging bad jobs to files
• statistics
• master - slave modle
• adding more instance on the fly
• etc.

It can work with all http-based interfaces written in any language.

The NetCircle has been using it for more than 18 months. It helps us to consume more than 6 million(the amount depends on your businsess type. Consumer Dispatcher wont be your bottleneck) jobs per day with around 25M memory and 2%cpu usage.

• What is Consumer Dispatcher and Why

• How it works

• How to use it

• How to write my consumder code

• Managing & Monitoring

• Run in master-slave way

• Wiki

• email: [email protected]

• weibo: http://www.weibo.com/jackyhung

• company: http://www.thenetcircle.com

• download the jar file

• follow the steps described here

• compile, package and eclipse project

• Consumer Dispatcher is setup to build using Maven

• You need JDK 1.6 + to build and run Consumer Dispatcher.

• Apache License, Version 2.0

##There definitely are loooooooot of room to improve Consumer Dispatcher. Any suggestion would be appreciated . Thank you for your support!