Service that works like kafka connect with:
- Mongo as a source or as a sink
- Kafka as a source or as a sink
It distributes the load using Orleans. (Basically my playground for orleans)
Batching and parallelization is done using Dataflow. Configuration is dynamic and depends on the type of source-sink or sink-source combo:
- Mongo to mongo
- Kafka to kafka
- Mongo to kafka
- Kafka to mongo
Examples of deployments can be found in deployment folder
Supports multi-cluster deployments using Konnect__Instance__Name env variable. Each cluster can have multiple pods in kubernetes or standalone.