Hi, when i try to run it, it shows the error below about lamda-rlhf-pytorch HOT 1 OPEN

Hi @HoxtonR ,

I just pushed an update to fix the import errors you had listed. One of the last updates had changed the file directory structure.

The repository initially consisted of just the pre-training architecture for the model but I am actively updating it on a daily basis to include a full pre-training example. The training script is not fully implemented as a tokenizer needs to still be provided and the package manager needs to be implemented since this model requires specific libraries for scaling.

I will be updating consistently and keep this issue open for now.

Best,

Enrico

from lamda-rlhf-pytorch.