lintangsutawika Goto Github PK

ajax

A fork of a fork of a fork of T5x Repo for my own experiments

augmented-pretraining

Generate Linked Document Pretraining data for LLMs

avito_demand_prediction

Bronze submission for Avito Demand Prediction competition on Kaggle

berkicau

Part of NER challange for Fasilkom UI NLP class 2017.

big-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

cot-t5

Config files for CoT on T5X

def-collections

Collection of Singularity Definition files for various usecases.

eval_t0_deepspeed

Evaluate T0 with DeepSpeed

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

imaterialist-furniture-challenge-2018

Pytorch code for iMaterialist Furniture Kaggle Competition

jax-stupid-backoff

Jax-based implementation of Stupid Backoff

licensed-pile

Repo to hold code and track issues for the collection of permissively licensed data

lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

lm_dataformat

long_tail_knowledge

Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"

megatron-deepspeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

multilingual-t0

Multilingual extension of T0

nertagger

Chrome Extension NER Tagger

paxml

promptsource

Toolkit for creating, sharing and using natural language prompts.

sc-practice

speed control development

seqio

Task-based datasets, preprocessing, and evaluation for sequence models.

t-zero

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

tgs-salt-identification-challenge

Submission for TGS Salt Identifier Challenge

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

trui-bot-prj

Work on making useful and winning robots.

word2vec_tutorial

Word2Vec tutorial with gensim on Indonesian tweets