Git Product home page Git Product logo

semurat / examples Goto Github PK

View Code? Open in Web Editor NEW

This project forked from confluentinc/examples

0.0 1.0 0.0 22.55 MB

Apache Kafka and Confluent Platform examples and demos

License: Apache License 2.0

Dockerfile 0.25% Shell 27.53% Makefile 3.68% SQLPL 1.17% Java 29.40% Emacs Lisp 0.03% C 14.74% C# 2.08% Go 2.31% Groovy 3.20% Kotlin 2.70% JavaScript 2.25% Python 4.97% Ruby 1.81% Scala 2.65% PLpgSQL 1.24%

examples's Introduction

image

Demo list

This is a curated list of demos that showcase Apache Kafka® stream processing on the Confluent Platform. Some demos run on local Confluent Platform installs (download Confluent Platform) and others run on Docker (install Docker and Docker Compose).

Where to start

The best demo to start with is cp-demo, which spins up a Kafka event streaming application using KSQL for stream processing. cp-demo also comes with a playbook and video series, and is a great configuration reference for Confluent Platform.

Full list

Demo Local Docker Category Description
Avro Y N Confluent Platform Examples of client applications using Avro and Confluent Schema Registry
CDC with MySQL N Y Data Pipelines Self-paced steps to setup a change data capture (CDC) pipeline
CDC with Postgres N Y Data Pipelines Enrich event stream data with CDC data from Postgres and then stream into Elasticsearch
Clickstream Y Y Stream Processing Automated version of the KSQL Clickstream demo
Cloud clients Y N Confluent Cloud Examples of client applications in different programming languages connecting to Confluent Cloud
Connect and Kafka Streams Y N Data Pipeline Demonstrate various ways, with and without Kafka Connect, to get data into Kafka topics and then loaded for use by the Kafka Streams API
CP Demo Y Y Confluent Platform Confluent Platform Demo with a playbook for Kafka streaming ETL deployments
CP Quickstart Y Y Confluent Platform Confluent Platform Quickstart
GCP pipeline N Y Data Pipeline Work with Confluent Cloud to build cool pipelines into Google Cloud Platform (GCP)
Hybrid cloud Y Y Confluent Cloud End-to-end demo of a hybrid Kafka Cluster between Confluent Cloud and on-prem using Confluent Replicator
KSQL UDF Y N Stream Processing Advanced KSQL UDF use case for connected cars
KSQL workshop N Y Stream Processing showcases Kafka stream processing using KSQL and can run self-guided as a KSQL workshop
Microservices ecosystem Y N Stream Processing Microservices Orders Demo Application integrated into the Confluent Platform
MQTT Y N Data Pipeline Internet of Things (IoT) integration example using Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data
Multi datacenter N Y Confluent Platform This demo deploys an active-active multi-datacenter design, with two instances of Confluent Replicator copying data bidirectionally between the datacenters
Music demo Y Y Stream Processing KSQL version of the Kafka Streams Demo Application
MySQL and Debezium Y N Data Pipelines End-to-end streaming ETL with KSQL for stream processing using the Debezium Connector for MySQL
Oracle, KSQL, Elasticsearch N Y Data Pipelines Stream data from Oracle, enrich and filter with KSQL, and then stream into Elasticsearch

Prerequisites

For local installs:

  • Confluent Platform 5.1
  • Env var CONFLUENT_HOME=/path/to/confluentplatform
  • Env var PATH includes $CONFLUENT_HOME/bin
  • Each demo has its own set of prerequisites as well, documented in each demo's README

For Docker:

  • Docker version 17.06.1-ce
  • Docker Compose version 1.14.0 with Docker Compose file format 2.1

examples's People

Contributors

colinhicks avatar confluentjenkins avatar danphanley avatar edenhill avatar joel-hamill avatar maxzheng avatar mhowlett avatar michaelhussey avatar rmoff avatar stanislavkozlovski avatar ybyzek avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.