hyperonym / ratus Goto Github PK

please add postgres support to the storage engine options

Good day. Thanks you for amazing tool.

I am considering this project but my question is, is it possible to implement partial ordering with this tool? I mean, suppose we have multiple consumers and we need to guarantee that tasks with the same hash (ordering group or somethink like that) will be processed by same consumer?

In kafka this is done automatically, in rabbitmq there is a plugin for that. You can read about partial ordering in this article

https://alexravikovich.medium.com/rabbitmq-partial-order-implementation-using-consistent-hash-exchange-golang-29ab6f439021

Thanks a lot.

Is: Currently the dockerfile does not contain a health check
Wish: Would it be possible to include a health check in the dockerfile?

My current workaround:

ARG BASE_IMAGE="hyperonym/ratus"

FROM alpine as builder
ADD https://github.com/moparisthebest/static-curl/releases/download/v8.7.1/curl-amd64 /curl
RUN chmod 700 /curl

FROM ${BASE_IMAGE}
COPY --from=builder /curl /curl

EXPOSE 80/tcp
HEALTHCHECK --interval=60s --timeout=10s --start-period=5s CMD ["/curl", "-sSf", "http://127.0.0.1/readyz"]

Allow producers to create tasks with a well-known id that will be interpreted by the server as a request for a server-generated id (in this example '0').

Update responses would include a list of ids alongside the counts, corresponding to the tasks submitted. Supplied ids would just be reflected back.

Calling

$ curl -X POST -d '{"payload": "hello world"}' "http://127.0.0.1:8000/v1/topics/example/tasks/0"

adds a task and has a response like

{"created":1,"updated":0,"ids":["52acfef8-d77e-45ff-aff9-4780ca414be1"]}

{
   "_id": "52acfef8-d77e-45ff-aff9-4780ca414be1",
   "topic": "example",
   "state": 0,
   "nonce": "",
   "produced": "2022-09-21T10:12:23.065074065Z",
   "scheduled": "2022-09-21T10:12:23.065074065Z",
   "payload": "hello world"
}

Unlike redis, the new in-memory storage engine should be embedded into Ratus.

go-memdb seems to be a good backend.