Git Product home page Git Product logo

anon-kafka-mirror's Introduction

anon-kafka-mirror - consume, anon, produce

npm version Docker Repository on Quay

Intro

Anonymize Kafka topics while mirroring them on the fly. Just pass a config file describing your topics and schema (and Kafka cluster connections) and start the service / container.

Example

  • Start docker compose setup: yarn setup
  • Produce some message to input topic: echo '{"test": 2, "abc":"cba", "id": "1", "mail": "[email protected]", "a":["test"], "b":[{"c":0},{"d":1}, {"c":1}], "z": [["test"],[]], "d": [[{"e": 0}, {"ex": 1}]], "f": [{"g": "g", "t": 1},"test"], "y": [1,2,3,4,5], "x":[{"x": 1, "y": 2}, {"g":2}] }' | kafka-console-producer --topic input --broker-list localhost:9092
  • Show output message in output topic : kafka-console-consumer --topic output --from-beginning --bootstrap-server localhost:9092

Maintainer

Build with โค๏ธ ๐Ÿ• and โ˜• by nodefluent

anon-kafka-mirror's People

Contributors

atd-schubert avatar dependabot[bot] avatar holgeradam avatar krystianity avatar rob3000 avatar yacut avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.