jaymon / mister Goto Github PK

Basically I would like a more general purpose manager that has a prepare function that will just load up a queue and then a map function that processes that queue and a reduce function that would aggregate anything if needed.

So the prepare function would be wrapped so whatever it returned was added to a queue, and then the map function would be wrapped so each wrapper would try and read the queue and if it got something it would send it into the passed in map function, and then if it got a return value it would then load it into a return value queue.

So the class would have 2 queues, and input and an output queue. I think the name could be "Miss" so we would have Mister and Miss that perform roughly the same function in different ways. Miss would be more of a general purpose batch task manager that would create a pool of processes that listen on the queue and then anything that is added to the input queue would be processed by one of its pool of processes.