An end to end production pipeline for reading real time streaming data from Mysql to Spark using Flume and Kafka and running a real time streaming regression on Spark, visualizing the results on terminal and writing the output back to MySQL.
MySQL => Flume => Kafka => Spark => MySQL
sh start_project.sh
- MySQL
- Hadoop
- Flume
- Kafka
- Spark