yangulei Goto Github PK

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

internlm-20b

llm-continuous-batching-benchmarks

mixtral-8x7b

mxnet2caffe

Convert MXNet model to Caffe model

optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

paddle

paddlecustomdevice

PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)

paddlefleetx

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep

tensorrt

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

tgi-gaudi

Large Language Model Text Generation Inference on Habana Gaudi

tlcbench

Benchmark scripts for TVM

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators