4agi Goto Github PK

llm-firefly

Firefly(流萤): 中文对话式大语言模型(全量微调+QLoRA)，支持微调Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya、Bloom等大模型

llm_training_handbook

An open collection of methodologies to help with successful training of large language models.

llmsurvey

A collection of papers and resources related to Large Language Models.

mesh-transformer-jax

Model parallel transformers in JAX and Haiku

ml-stable-diffusion

Stable Diffusion with Core ML on Apple Silicon

openchatkit

p-tuning

A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.

parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

petals

🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

playground

Treesitter playground integrated into Neovim

segment-anything

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

self-instruct

Aligning pretrained language models with instruction data generated by themselves.

siyuan

Build Your Eternal Digital Garden

stable-diffusion-webui

Stable Diffusion web UI

stablediffusion

High-Resolution Image Synthesis with Latent Diffusion Models

stanford_alpaca

Code and documentation to train Stanford's Alpaca models, and generate the data.

swarm-jax

Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

the-twitter-algorithm

Source code for Twitter's Recommendation Algorithm

tj-config

My configuration files and tools

tuning_playbook

A playbook for systematically maximizing the performance of deep learning models.

vit_10b_fsdp_example

See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md