mehroosali Goto Github PK

followers: 9.0 following: 9.0 repos: 16.0 gists: 0.0

Name: Mehroos Ali

Type: User

Bio: MS CS graduate at the University of Texas at Dallas | Data Engineer | Software Developer

Location: Richardson, Texas

< Hello World, I'm Mehroos Ali />

I am a collaborative data engineering professional with substantial knowledge and experience in analysis, design, development, implementation, migration, convergence, management, and support of large-scale databases, data warehouses, and big data systems by creating intuitive architectures and frameworks that help organizations effectively capture, store, process, visualize and analyze huge volume of structured, semi-structured, unstructured and stream of heterogeneous data set.
I am currently pursuing my Masters in Computer Science at the University of Texas at Dallas specializing in Intelligent Systems.
I have previously interned at Amazon as Data Engineer this past summer where I gained knowledge and experience working with design and development of streaming data pipelines.
I have previously worked as a Data Engineer for Onward Technologies which is a global IT service provider in domains such as data analytics, data science, Artificial Intelligence (AI) and Machine Learning (ML). Before that I was working with Cognizant on their flagship Core Banking and Insurance customer - Suncorp.
I am interested in Big Data Engineering, Cloud Data Warehousing, Devops and Full Stack Development.
📩 Feel free to reach me at [email protected].

🛠 My Toolkit

🏆 Github Stats

🤝 Let's stay connected!

Mehroos Ali's Projects

abcstorespipeline

Batch ETL data pipeline built on HDP 3.0 to process daily sales and business data to procedure power Bi reports. Automated the pipelines using Airflow.

assembly_file_statistics

Assembly project to compute file statistics using MIPS for class CS5330 (Computer Architecture) at the University of Texas at Dallas.

batch_number_conversion

batch number conversion project using MIPS for class CS5330 (Computer Architecture) at the University of Texas at Dallas.

bigquery-sparksql-batch-etl

Batch ETL pipeline project on GCP to load and transform daily flight data using Spark to update tables in BigQuery. The pipeline is automated using Airflow.

databricks-f1-project

A data pipeline project build on databricks and azure to demostrate lifecycle of a cloud data project.

ebay-db-design

Ebay database design project for the class CS6360 (Database Design) at the University of Texas at Dallas.

information-retrieval-search-engine

Search Engine project for Information Retrieval class.

kruskals-algorithm

Kruskal's algorithm project using Java for class CS5343 (Data Structures and Algorithms) at the University of Texas at Dallas.

maze-solver

Maze Solver project using Java for class CS5343 (Data Structures and Algorithms) at the University of Texas at Dallas.

muy-feliz

Android application project in react ecosystem for the class CS 6326 (Human Computer Interaction).

realtime-customer-viewership-analysis

data pipeline using the lambda architecture is created for the unification and consolidation of real-time customer web events, weblogs, and profile data into a hive warehouse for adhoc analysis.

s3-redshift-batch-etl-pipeline

Built functional python ETL script with functions that initialized spark clusters using pyspark library to extract songs stored in S3 bucket. Partitioned songs data by year and artist_id and compressed in parquet output files to increase load performance. Used the overwrite mode in spark to ensure every new run of ELT script is overwritten in the data lake to avoid duplicates. Orchestrated ELT data pipeline that extracts from S3, loads in redshift for transformation and loads output back to S3. Used hooks in airflow to make connection credentials configurable in order to separate access rights from code base for security. Used operators to execute loading and transformation scripts for redshift with airflow DAG.

twitter-sentiment-analysis

personal project to pull live Twitter data using Nifi getTwitter processor and pushes to Kafka topic which is then consumed by a Spark Streaming application where basic sentiment analysis is performed and the final result is stored in elastic search for visualization using Kibana.

word-puzzle

Word Puzzle project using Java for class CS5343 (Data Structures and Algorithms) at the University of Texas at Dallas.

mehroosali Goto Github PK

< Hello World, I'm Mehroos Ali />

🛠 My Toolkit

🏆 Github Stats

🤝 Let's stay connected!

Mehroos Ali's Projects

Recommend Projects

Recommend Topics

Recommend Org