Git Product home page Git Product logo

brightosas / youtube-data-pipeline Goto Github PK

View Code? Open in Web Editor NEW
1.0 1.0 1.0 2.99 MB

Developed a data pipeline designed to retrieve information on YouTube channels created in the year 2023. Implement processes for extracting channel snippets and statistics to generate comprehensive insights. Culminate the pipeline with the preparation of data for visualization, facilitating informed and visual representation of key metrics.

Python 34.09% Dockerfile 0.08% HCL 0.03% Jupyter Notebook 65.80%
airflow aws aws-cloudwatch aws-lambda aws-s3 boto3 data-engineering dbt-cloud docker looker-studio

youtube-data-pipeline's Introduction

HELLO👋! WELCOME TO MY PROFILE

I specialize in Analytic Engineering, leveraging my expertise to design end-to-end solutions that optimize performance, ensure reliability, and enhance security across analytics and cloud environments. My passion lies in adopting cutting-edge technologies to drive efficiency and foster innovation.

Skill set

Python github git postgresql mysql dbt apache airflow
apache spark docker terraform apache kafka
Amazon aws microsoft
powerbi tableau looker

Certifications

youtube-data-pipeline's People

Contributors

brightosas avatar

Watchers

avatar

youtube-data-pipeline's Issues

Review

A comprehensive review of the project

  • No .env_sample file
  • Add .gitignore file
  • Remove exposed secrets from compose file
  • Consolidate all README.md files in root directory

How to run system

How do you run the project?

  • Write a proper way of running the application - https://github.com/Manny-97/Data2bots-Capstone
  • Attach it as part of the readme file

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.