A POC code repository to show an event flowing from
- Kafka
- Broadway
- Elixir Pubsub
- Live View
- Create postgresql datastore.
- Create kafka datastore.
- Create a public web app. (Remember
app-namefor later) - Add the postgresql datastore (from step 1) to the app.
- Add the kafka datastore (from step 2) to the app.
- Add the
SECRET_KEY_BASE for Rails Cookiescapability to the app. (this capability works for Rails and Phoenix) - Provision
nullstone up --wait --block=<app-name> --env=<env-name>- Build, push, and deploy
docker build -t pubsublive .
nullstone launch --source=pubsublive --app=<app-name> --env=<env-name># Start zookeeper, kafka, and postgres (detached)
docker compose up -d db kafka zookeeper
# Start app and tail logs
docker compose up appCreate a topic. FOr this demo, we are using the topic "orders"
docker compose exec kafka kafka-topics.sh --create --topic orders --bootstrap-server kafka:9092Visit http://localhost:4000/ticker
Get the latest version of Kafka
Start the server
$ bin/zookeeper-server-start.sh config/zookeeper.properties
$ bin/kafka-server-start.sh config/server.properties
Create a topic, if not already in place. For this demo we are using the topic "orders"
$ bin/kafka-topics.sh --create --topic orders --bootstrap-server localhost:9092
Send messages to Kafka, to be picked up by Broadway, to send to Phoenix to send to FE
# Format is unique id, name, and a price. Name and price will update based on ID
# Number of messages to send
PubsubLive.Orders.simulate(100)
lib
├── pubsublive
│ ├── application.ex # Broadway Config
│ ├── my_broadway.ex # Broadway Code to accept Kafka
│ ├── orders.ex # Generate messages for Kafka
└── pubsublive_web
├── live
│ ├── ticker.ex # Ticker LiveView, most of the code is here
│ └── ticker_component.ex # Ticker Component
└── router.ex # routes added for /ticker
assets
├── css
│ └── app.css # Styling for flash on change
└── js
└── app.js # Small hook for JS/LiveView Interop to flash
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent