xzacrhhh Goto Github PK

cmake-template

提供良好的cmake配置，减少配置时间，同时提供常用cpp配置选项

cuda_hgemm

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

cute-gemm

cutlass

CUDA Templates for Linear Algebra Subroutines

fastllm

纯c++的全平台llm加速库，支持python调用，chatglm-6B级模型单卡可达10000+token / s，支持glm, llama, moss基座，手机端流畅运行

how-to-optim-algorithm-in-cuda

how to optimize some algorithm in cuda.

intelligent_tooth_detection_system

ort_eigen

ort_pro

pytorch_grouped_gemm

High Performance Grouped GEMM in PyTorch

qwen1.5

Qwen1.5 is the improved version of Qwen, the large language model series developed by Qwen team, Alibaba Cloud.

tensorrt-llm

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

tvm_mlir_learn

compiler learning resources collect.

yolov6-trt