This project constitutes my solutions to the Data Engineering ZoomCamp 2022 Course
During this course the following milestones are achieved:
- Local hosting of a Postgress DataBase using Docker
- Local hosting of an Airflow using Docker
- An ETL pipeline to fill the database with data from the NY Taxi Dataset
- More comming soon
In order to create the postgress db simply execute the following command:
docker compose -f ./database/docker-compose.yaml up -d --build
After the initial creation, in order to activate the database execute the previous command without the --build
docker compose -f ./database/docker-compose.yaml up -d