dumpmemory / olm-training Goto Github PK
View Code? Open in Web Editor NEWThis project forked from huggingface/olm-training
Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
License: Apache License 2.0