hanrui1sensetime Goto Github PK

atom

Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

autoawq

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

gptq-for-pulse

4 bits quantization of PULSE models using GPTQ

llm-awq

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLM

mmaction2

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

mmclassification

OpenMMLab Image Classification Toolbox and Benchmark

mmdeploy

mmdeploy-javaapi-testdata

mmdeployx-apk

APK resources of MMDeploy-X

mmdeployx-prototype

The prototype of MMDeployX

mmdetection

OpenMMLab Detection Toolbox and Benchmark

mmediting

OpenMMLab Image and Video Restoration, Editing and Generation Toolbox

mmpose

OpenMMLab Pose Estimation Toolbox and Benchmark.

mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

mmyolo

OpenMMLab YOLO series toolbox and benchmark

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

omniquant

OmniQuant is a simple and powerful quantization technique for LLMs.

paddlevideo

Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.

posetracker-android-prototype

PoseTracker Android Demo Prototype.

quik

Repository for the QUIK project, enabling the use of 4bit kernels for generative inference

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.