ofili Goto Github PK

analyzing-visualizing-data-powerbi

This repository contains the lab files and other resources for the free Microsoft course DAT207x: Analyzing and Visualizing Data with Power BI. To learn how to connect, explore, and visualize data with Power BI, sign up for this course on edX.

apple

behavior-analytics

This project builds a data pipeline to populate the user_behavior_metric table. The user_behavior_metric table is an OLAP table, meant to be used by analysts, dashboarding.

bigquery-etl

Simple ETL script to migrate data from BigQuery to Postgres database.

coincap

data-engineering-zoomcamp

Free Data Engineering course!

data-lake

This project builds an ETL pipeline for a data lake hosted on S3. We will load data from S3, process the data into analytics tables using Spark, and load them back into S3. We will deploy this Spark process on a cluster using AWS.

data-modeling-with-cassandra

data-modeling-with-postgres

data-pipeline-with-gcp

This project implements a data ingestion and processing pipeline to collect, store and process time-series data. The pipeline consists of a publisher, a message queue (Pub/Sub), a consumer, a data warehouse (BigQuery) and a data extractor. The pipeline is designed to be scalable, efficient and easy to maintain.

data-warehouse

This project creates an ETL pipeline to build a data warehouse hosted on Redshift.

data_cleaning_python_2883183

Data Cleaning in Python Essential Training

data_pipeline_with_airflow

This project builds a data pipeline that ingests Sparkify's music data into an AWS Redshift Data Warehouse. The ETL pipeline will be run on an hourly basis, scheduled using Airflow.

dbt-fundamentals

de-assessment

The workflow brings the data into a PostgreSQL database.

dp-203-data-engineer

etl-data-pipeline-project

investigate-a-dataset

jetbrain-activation-code

jetbrain software全家桶激活码activation code, including intellij idea，pycharm，datagrip, webstorm...

jetbrain-activation-code-1

jetbrain software全家桶激活码activation code, including intellij idea，pycharm，datagrip, webstorm...

js-development-environment

learningsparkv2

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

mysqlbackup

This script performs automated backups of a MySQL database using the mysqldump command. It allows you to schedule daily backups and provides a notification upon successful completion.

mysqldump

nyc-taxi-data

This etl pipeline extracts and integrates NYC Taxi Trip Data with Taxi Zone Lookup Data to create a dataset that can be used for descriptive and predictive analysis. For example, to predict the number of trips per day for a given taxi zone.

oauth-api

ofili

pyspark-template

Structured Streaming app that can read files from the local system folder as new files are added to the folder as stream data and apply all the operations on the new data and, finally, write the results in an output directory.

real-time-analytics-platform

The Real-Time Analytics Platform is a robust and scalable solution designed to ingest, process, and visualize high-volume data streams in real-time.

smartpipenet