alishafique3 Goto Github PK

alishafique3

alishafique3.github.io

Welcome to my personal technical website! Here, you'll find a curated collection of my research projects, tutorials, and insightful technical blogs. As a passionate researcher and learner in the field of Generative AI, I aim to share my knowledge and research with fellow enthusiasts and aspiring learners.

deep_learning_performance_characterization_for_quantization_frameworks

This study has employed various performance metrics to identify the key factors in model architectures that impact quantization performance. Quantization techniques include automatic mixed precision and post-training quantization.

distributed_training_of_llm_using_deepspeed

In this project, LLM (model: distilbert) is finetuned on a multiple GPUs for text classification task. Distributed training is performed using deepspeed (ZeRO 1, 2, and 3) with profiling in wandb.

efficient_inference_optimizations_and_benchmarking

This project utilizes model optimization techniques such as pruning, clustering and quantization that enables efficient use of memory, less power consumption and make computations simple.

finetuning_of_llm_on_single_gpu_using_qlora

In this project, LLM (model: T5-3b) is finetuned on a single GPU for summarization task. Memory footprints of the model is reduced using PEFT technique called Quantized LoRA.

llm-evaluations-hub

A repository that provides a thorough collection of approaches and methods used for evaluating Large Language Models (LLMs).

ml_and_dl_made_easy

Here, I talk about cool stuff of deep learning. I try to explain tricky things in a storytelling way. Whether you know a lot about these concepts or just a bit, my blogs will help you to learn or refresh your concepts.

pytorch_training_optimization_with_memory_analysis

In this project, training stage is optimized using memory analysis in Pytorch Tensorboard. Automatic mixed precision, increased batch size, reduced H2D copy, multiprocessing and pinned memory techniques are used for optimizations.

sales-insights_data-analysis-using-sql-and-tableau

uber_and_lyft_data_analysis_and_price_prediction

In this project, the goal is to develop a regression model to predict the price of Uber and Lyft rides in Boston MA.