Authors : DRIOUCHE Adnane, FAKIRI Ismail, EL AMRANI EL IDRISSI Oumaima et OUAZIZ Hajar

This project will allow you to predict the price of bitoin in real time using Kafka, Spark and MongoDb as a database.
This is the architecture of the App :

We are using the Messari's API to collect data in real-time.

Description of files :

• producer.py : this is a python script that create our own Kafka Producer.
• kafka_mongo.py : this is our Consumer that get data from the producer and stock them on MongoDB
• Mongo_Spark_LSTM.ipynb : this file content is a script of our model LSTM that starts automatically every hour

First, you have to install Spark and Kafka. To install Kafka for :

• Windows 10 : see this link
• Ubuntu 16.04 & 18.04 : see this link

To install Spark :

• Windows 10 : see this link
• Ubuntu 16.04 & 18.04 : see this link

Then install the dependencies and devDependencies.

$ pip install requirements.txt

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Please make sure to update tests as appropriate.

This is a Free project ! Feel Free and clone it :)