careeratg Goto Github PK

airflow-training

Introduction to the data pipeline management with Airflow. Airflow schedule and maintain numerous ETL processes running on a large scale Enterprise Data Warehouse.

awesome-etl

A curated list of awesome ETL frameworks, libraries, and software.

bi-project

Developing end to end ETL process evolving dashboard and KPI's

business-intelligence-project-with-talend-and-powerbi

My first project working with TALEND and PowerBI

data-integration-with-pandas

data-science-ipython-notebooks

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

db-sample-schemas

Oracle Database Sample Schemas

etl-elt-talend

Used Talend as an ETL and orchestrator for jobs to load Banking data files and load Teradata Warehouse

etl-workflow

ETL workflow and data analysis. ETL-workflow using prefect and pygrametl (SCD, slow changing dimension). Product classification based on product name.

example-talend-query-insert-update-from-mongodb

getting-started-with-talend-open-studio-for-data-integration

Getting Started with Talend Open Studio for Data Integration, published by Packt

imdb-analysis

This repository contains analysis of IMDB data from multiple sources and analysis of movies/cast/box office revenues, movie brands and franchises.

imdb-data-warehouse-and-bi

Designed and developed Dimensional Model and performed data profiling, ETL operations for staging using Alteryx. Created data integration workflow in Talend to load data in AzureSQL and BigQuery DW and visualized analytical data reports dashboard using Tableau and PowerBI to get the insights and single truth story of the data

imdb-data-warehousing-bi

Implemented an Analytical Data Architecture (ADA) to create a single source of truth (SSOT) from multiple data sources such as CSV files and SQL databases for IMDb and the Numbers datasets

misc-scripts

Scripts from Office Hours sessions, blog posts or anything else that needed a script :-)

new-york-city-arrests-data-modelling-analysis-and-visualization

Analysis of New York State Police Department Arrests dataset. Created Dimensional Model for the provided dataset. Using Alteryx and Talend, built ETL pipelines to process, clean the data and create dimensions and facts in the destination database. Further, visualized the necessary details of the database using Tableau and PowerBI.

pymongo-fastapi-crud

PyMongo with FastAPI CRUD application

pyspark-cheatsheet

🐍 Quick reference guide to common patterns & functions in PySpark.

pyspark-examples

Pyspark RDD, DataFrame and Dataset Examples in Python language

python-data-exploration-analysis-cricketipl

pythondataanalysis

Python data repo, jupyter notebook, python scripts and data.

quandal_api

As part of my Data Engineering professional development, I am developing an array of data pipelines which extract, transform and load the data from various sources such as this Quandal API, CSV, JSON and database such as Google BigQuery, Microsft SQL Server and PostgreSQL, just to name a few.

retail-data-warehouse-analysis

This Project aims at creating a data warehouse for e-commerce based company, transforming data in ETL tools like Alteryx and Talend and then performing analytics as per user requirements.

snowflake-cookbook

Snowflake Cookbook, published by Packt

stocks-analyser

ETL Repository for stocks parsing

talend

Talend ETL & ESB

talend-class-example

talend-open-studio-cookbook

Published by Packt

talend-with-bigdata

Talend with Big Data

testpub