dat-a-man Goto Github PK

.github

airflow_example

amanguptanalytics

amanguptanalytics-project-two-ny-taxi-data

Uses many technologies, as mentioned in Readme.md

beginners-workshop-2022

Beginners' Workshop 2022 - Please fork to use!

course-certified-solutions-architect-associate

AWS Certified Solutions Architect - Associate

data-engineer-handbook

This is a repo with links to everything you'd ever want to learn about data engineering

data-engineering-zoomcamp

Free Data Engineering course!

data_engineering_best_practices

dlt-docs

dlt-dwh-dbt-transformations

A temp repo to store the dbt code for staging dimensional model of github

dq_tool

Basic Building Blocks of the tool

finance_pipeline_yahoo

A pipeline that would provide from and too rate conversions for currencies for any specific date. The purpose of the pipeline is to test "dlt state" function.

forvscodeserver

Repo to be used for accessing the remote instance via VS code Server edition which does not require an install and can be accessed via browser

ga4_dimensional_model

DImensional model developed for GA4 export. It is developed for one table for a particular date and it's corresponding event params.

gitpub_pipeline_modified

I have made some alterations to the original GitHub pipeline. Now, you can load stargazers through the stargazers resource in the github_reaction source. Additionally, you can view more information about pull requests, such as reviews, comments on reviews, and reactions on comments on reviews. You can also see the head and base repositories of PR.

ineuron

jira_pipeline

Making Jira pipeline for Bridge using dlt

machine-learning

A repo to keep track of all the machine learning

mlbookcamp-code

The code from the Machine Learning Bookcamp book

notionpipeline

pipelines

Contrib README.md for python-dlt

pokemon

A repo to check running dlt with cloud functions

project-four-analysis-using-pyspark

The taxi data used in project three is ingested in this project and analysed using Spark SQL, connecting Spark to GCS bucket and Running the Spark job on Data proc.

project-one-analytics-engineering-using-dbt-and-bq

End-To-End data project, with dashboards created for busisness to know the most selling product, sales agent tracking, product inventory dashboards and more.

project-three-ny-taxi-end-to-end

Uses python scripting with Airflow. Data is modeled with dbt and analyzed for Dashboarding via Tableau.

project-two-bitcoin-covid-timeseries-comparison

The project was started in July-2022 with suggestion from my mentor Adrian Brudaru and everything was done from ground zero from there.

reasons-i-quit

A repo to share the reasons you decided to quit with your colleagues without writing too much

retl

slack_pipeline

A pipeline for slack using dlt