matrix97317 Goto Github PK

alpaca-lora

Instruct-tune LLaMA on consumer hardware

awesome-ai-system

paper and its code for AI System

awesome-embodied-ai

This repository mainly organizes resources related to embodied intelligence, including data, models, hardware, and software infrastructure.

beginner-compiler

This repository is used to study compiler technology based on MLIR.

compiler-and-arch

A list of tutorials, paper, talks, and open-source projects for emerging compiler and architecture

cplusplusthings

C++那些事

cuda-optimization-guide

Xiao's CUDA Optimization Guide [Active Adding New Contents]

cuda_hgemm

Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

cutlass

CUDA Templates for Linear Algebra Subroutines

dissectingtensorcores

efficient-llms-survey

Efficient Large Language Models: A Survey

flops-counter.pytorch

Flops counter for convolutional networks in pytorch framework

funasr

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models. ｜语音识别工具包，包含丰富的性能优越的开源预训练模型，支持语音识别、语音端点检测、文本后处理等，具备服务部署能力。

gaussian-splatting

Original reference implementation of "3D Gaussian Splatting for Real-Time Radiance Field Rendering"

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

hidet

An open-source efficient deep learning framework/compiler, written in python.

inter-operator-scheduler

[MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration

interview

iree

👻

leetcode-master

LeetCode 刷题攻略：200道经典题目刷题顺序，共60w字的详细图解，视频难点剖析，50余张思维导图，支持C++，Java，Python，Go，JavaScript等多语言版本，从此算法学习不再迷茫！🔥🔥 来看看，你会发现相见恨晚！🚀

linear-attention-transformer

Transformer based on a variant of attention that is linear complexity in respect to sequence length

llama-recipes

Examples and recipes for Llama 2 model

llama3

The official Meta Llama 3 GitHub site

llm-research

llm-viewer

Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

lut-gemm

mamba

mandarin-tts

Chinese Mandarin tts text-to-speech 中文 (普通话) 语音 合成 , by fastspeech 2 , implemented in pytorch, using waveglow as vocoder, with biaobei and aishell3 datasets

marlin

FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

matrix97317