Git Product home page Git Product logo

spotify-etl's Introduction

Spotify Extract Transform Load Project (End to End Data Engineering)

Project Explanation https://www.youtube.com/watch?v=YOnVlg0lJa4&feature=youtu.be

Problem Statement

You are working with a Social Media and Talent Recognition Company.
Create a Database, scraping data from the Spotify Top 50 Tracks. Store the music, album and artist data seperately, the Talent Agency should be able to swiftly contact the singers for partnerships.

Proposed Solution

  • Amazon S3: Amazon S3 is an object storage service that provides manufacturing scalability, data availability, security, and performance.
  • AWS IAM: This is nothing but identity and access management which enables us to manage access to AWS services and resources securely.
  • AWS Glue: A serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development.
  • AWS Lambda: Lambda is a computing service that allows programmers to run code without creating or managing servers.
  • AWS Athena: Athena is an interactive query service for S3 in which there is no need to load data it stays in S3.

    Architecture Diagram Image

    • spotify-etl's People

    Contributors

    ashwanthsai avatar

    Stargazers

    avatar

    Watchers

    avatar

    Recommend Projects

    • React photo React

      A declarative, efficient, and flexible JavaScript library for building user interfaces.

    • Vue.js photo Vue.js

      🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

    • Typescript photo Typescript

      TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

    • TensorFlow photo TensorFlow

      An Open Source Machine Learning Framework for Everyone

    • Django photo Django

      The Web framework for perfectionists with deadlines.

    • D3 photo D3

      Bring data to life with SVG, Canvas and HTML. 📊📈🎉

    Recommend Topics

    • javascript

      JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

    • web

      Some thing interesting about web. New door for the world.

    • server

      A server is a program made to process requests and deliver data to clients.

    • Machine learning

      Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

    • Game

      Some thing interesting about game, make everyone happy.

    Recommend Org

    • Facebook photo Facebook

      We are working to build community through open source technology. NB: members must have two-factor auth.

    • Microsoft photo Microsoft

      Open source projects and samples from Microsoft.

    • Google photo Google

      Google ❤️ Open Source for everyone.

    • D3 photo D3

      Data-Driven Documents codes.