radarfudan Goto Github PK

18.408

annotated-mamba

Annotated version of the Mamba paper

attention_with_linear_biases

Code for the ALiBi method for transformer language models (ICLR 2022)

awd-lstm-lm

LSTM and QRNN Language Model Toolkit for PyTorch

awesome-neural-ode

A collection of resources regarding the interplay between differential equations, deep learning, dynamical systems, control and numerical methods.

awesome-state-space-models

Collection of papers on state-space models

benchmark_sequence_modeling

causal-conv1d

Causal depthwise conv1d in CUDA, with a PyTorch interface

cheatsheets

Official Matplotlib cheat sheets

cuda_programming

Code from the "CUDA Crash Course" YouTube series by CoffeeBeforeArch

curse-of-memory

Curse-of-memory phenomenon of RNNs in sequence modelling

dockers

easylm

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

effhdc

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

flash-attention

Fast and memory-efficient exact attention

flash-fft-conv

FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

gateloop-transformer

Implementation of GateLoop Transformer in Pytorch and Jax

google-research

Google Research

hasee

in-context-operator-networks

ICON for in-context operator learning

interest

Temporal re-weighting improve the long-term memory learning.

lhj

Can we use lightning as data loader and jax as the models?

lightning-hydra-template

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

lm-rmt_bala

Recurrent Memory Transformer

longmamba

Some preliminary explorations of Mamba's context scaling.

lp_solver

project for Linear programming

mamba

mamba-minimal

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.