Topic: pipeline-parallelism Goto Github
Some thing interesting about pipeline-parallelism
Some thing interesting about pipeline-parallelism
pipeline-parallelism,Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
Organization: alibaba
pipeline-parallelism,An Efficient Pipelined Data Parallel Approach for Training Large Model
Organization: alibabapai
pipeline-parallelism,🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Organization: bigscience-workshop
Home Page: https://petals.dev
pipeline-parallelism,Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
User: coobiw
pipeline-parallelism,pipeDejavu: Hardware-aware Latency Predictable, Differentiable Search for Faster Config and Convergence of Distributed ML Pipeline Parallelism
User: explcre
pipeline-parallelism,Official implementation of DynPartition: Automatic Optimal Pipeline Parallelism of Dynamic Neural Networks over Heterogeneous GPU Systems for Inference Tasks
User: fanpu
pipeline-parallelism,Model parallelism for NN architectures with skip connections (eg. ResNets, UNets)
User: garg-aayush
pipeline-parallelism,Making large AI models cheaper, faster and more accessible
Organization: hpcaitech
Home Page: https://www.colossalai.org
pipeline-parallelism,A GPipe implementation in PyTorch
Organization: kakaobrain
Home Page: https://torchgpipe.readthedocs.io/
pipeline-parallelism,Development of Project HPGO | Hybrid Parallelism Global Orchestration
User: ler0ever
Home Page: https://HPGO.rongyi.io
pipeline-parallelism,DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Organization: microsoft
Home Page: https://www.deepspeed.ai/
pipeline-parallelism,Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
User: nawnoes
pipeline-parallelism,LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
Organization: oneflow-inc
Home Page: https://libai.readthedocs.io
pipeline-parallelism,飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
Organization: paddlepaddle
pipeline-parallelism,FTPipe and related pipeline model parallelism research.
User: saareliad
pipeline-parallelism,A curated list of awesome projects and papers for distributed training or inference
User: shenggan
pipeline-parallelism,Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.
User: shigangli
pipeline-parallelism,Boosting DL Service Throughput 1.5-4x by Ensemble Pipeline Serving with Concurrent CUDA Streams for PyTorch/LibTorch Frontend and TensorRT/CVCUDA, etc., Backends
Organization: torchpipe
Home Page: https://torchpipe.github.io/
pipeline-parallelism,Docs for torchpipe: https://github.com/torchpipe/torchpipe
Organization: torchpipe
Home Page: https://torchpipe.github.io/
pipeline-parallelism,Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
User: xrsrke
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.