Tanay Bhardwaj's Projects
The description of energy profiles of Arizona, California, New Mexica, and Texas is provided in the analysis.
Built an ETL pipeline that extracts their data from S3, stages them in Redshift, and transforms data into a set of dimensional tables. Load data from S3 to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.
Load data from S3, process the data into analytics tables using Spark and load them back into S3. Deployed this Spark process on a cluster using AWS EMR
Data modeling with Postgres and built ETL pipeline that transfers data from files in two local directories into tables in Postgres using Python and SQL.
Data modeling with Apache Cassandra and completed an ETL pipeline using Python. Build an ETL pipeline that transfers data from a set of CSV files within a directory to create a streamlined CSV file to model and insert data into Apache Cassandra tables.
Built Data Pipelines with Airflow. Created custom operators to perform tasks such as staging the data, filling the data warehouse, and running checks on the data as the final step
Built a Machine Learning Pipeline to categorize emergency messages based on the needs communicated by senders
It is based on the book "The Levelling" by Micheal O'Sullivan
Created models to predict which Medicare members are most likely to struggle with transportation challenges
Jenkins Test
Basic Example of how to use Kafka with Spring Boot in Java
Time Series Analysis of 1.1 Billion rows of data of the famous New York City Yellow Taxi from 2009-2015
Twitter Analysis of Chic-fil-A and Popeyes was conducted when Popeyes released its much-anticipated Chicken Sandwich
Denver Real Time Data Engineering and Analytics
Analyzed the interactions that users have with articles on the IBM Watson Studio platform, and made recommendations to them about new articles they will like
The Website that has detailed description of me
Home Screen Profile