Spotify Extract Transform Load Project (End to End Data Engineering)
Project Explanation
https://www.youtube.com/watch?v=YOnVlg0lJa4&feature=youtu.be
Problem Statement
You are working with a Social Media and Talent Recognition Company.
Create a Database, scraping data from the Spotify Top 50 Tracks.
Store the music, album and artist data seperately, the Talent Agency should be able to swiftly contact the singers for partnerships.
Proposed Solution
Amazon S3: Amazon S3 is an object storage service that provides manufacturing scalability, data availability, security, and performance.
AWS IAM: This is nothing but identity and access management which enables us to manage access to AWS services and resources securely.
AWS Glue: A serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
AWS Lambda: Lambda is a computing service that allows programmers to run code without creating or managing servers.
AWS Athena: Athena is an interactive query service for S3 in which there is no need to load data it stays in S3.
Architecture Diagram
![Image](https://github.com/AshwanthSai/Spotify-ETL/raw/869cb41132d15914fdc6b5857898a5db64909617/Architecture%20Diagram.png)