Fused Cross Entropy is not installed. Either (1) have a CUDA-compatible GPU and `pip install .[gpu]`, or (2) set your config model.loss_fn=torch_crossentropy. about llm-foundry HOT 9 CLOSED

It looks like you didn't install all the requirements (pip install .[gpu] from the top level dir).

from llm-foundry.

Yes the current setup depends on torch==1.13.1
torch2 has some issues but we will upgrade when these are resolved
(Note: people have run our repo with torch2, but it does disable some of the features)

I'd recommend creating a new venv (python -m venv venv) and installing the requirements from scratch (pip install .[gpu])
(you might need to install torch first: pip install torch==1.13.1)

from llm-foundry.

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
torchdata 0.6.0 requires torch==2.0.0, but you have torch 1.13.1 which is incompatible.
torchaudio 2.0.1+cu118 requires torch==2.0.0, but you have torch 1.13.1 which is incompatible.

it installs the old version of torch

from llm-foundry.

(pip install .[gpu] thats the command i ran

from llm-foundry.

I am seeing the exact same issue, and I did install with pip install .[gpu]. My torch version is also 1.13.1, I have a venv specifically for this project.

from llm-foundry.

I guess the problem is from the CUDA version not PyTorch version.

from llm-foundry.

Im having the same issue. Im using the docker image [2.0.1_cu117-python3.10-ubuntu20.04-aws] and don't use a Venv. I can run the hf_ generate.py but I can't run train.py

from llm-foundry.

Im having the same issue. Im using the docker image [2.0.1_cu117-python3.10-ubuntu20.04-aws] and don't use a Venv. I can run the hf_ generate.py but I can't run train.py

Use the recommended docker image

from llm-foundry.

thanks my mistake

from llm-foundry.