This project automates data pipelines using EMR and Lambda
- Automate work flows in AWS
- Create EMR clusters on demand
- Minimize costs from redundant clusters by creating new ones and terminating them when work is done
https://medium.com/@jkimera5/automating-data-pipelines-with-aws-s3-emr-and-lambda-d96b27d27224