python -c 'import deepspeed; deepspeed.ops.adam.cpu_adam.CPUAdamBuilder().load()'

按照这里的方法，解决了 <a class="issue-link js-issue-link" data-error-text="Failed to load title"

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="

same problem <div class="snippet-clipboard-content notranslate position-relative o

RuntimeError: Error building extension 'cpu_adam', because /usr/bin/ld: can not find -lcurand，help! about deepspeed HOT 5 OPEN

hekaijie123 commented on July 22, 2024

RuntimeError: Error building extension 'cpu_adam', because /usr/bin/ld: can not find -lcurand，help!

from deepspeed.

Comments (5)

fly-dragon211 commented on July 22, 2024 1

按照这里的方法，解决了 #3929 (comment)

cd /home/asdf/.local/lib/python3.10/site-packages/torch/lib
ln -s /usr/local/cuda/lib64/libcurand.so .

there is no lib64 under /home/enwei/anaconda3/envs/llama. So I copied everything in lib to lib64, and the problem is solved for me.

from deepspeed.

lekurile commented on July 22, 2024 1

Hi @hekaijie123,

Can you please share your environment variables, specifically LIBRARY_PATH and LD_LIBRARY_PATH?

We've found that explicitly setting LIBRARY_PATH to point to lib64 resolves this exact issue, e.g.:

export CUDA_HOME="/usr/local/cuda-12.5"
export LIBRARY_PATH="/usr/local/cuda-12.5/lib64:$LIBRARY_PATH"
export LD_LIBRARY_PATH="/usr/local/cuda-12.5/lib64:$LD_LIBRARY_PATH"

from deepspeed.

Mr-lonely0 commented on July 22, 2024

same problem.
Have you solved it?

from deepspeed.

Mucalinda2436 commented on July 22, 2024

same problem！why

from deepspeed.

fly-dragon211 commented on July 22, 2024

same problem

Building extension module cpu_adam...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/1] c++ cpu_adam.o cpu_adam_impl.o -shared -lcurand -L/data/miniconda3/envs/env-novelai/lib/python3.10/site-packages/torch/lib -lc10 -ltorch_cpu -ltorch -ltorch_python -o cpu_adam.so
FAILED: cpu_adam.so 
c++ cpu_adam.o cpu_adam_impl.o -shared -lcurand -L/data/miniconda3/envs/env-novelai/lib/python3.10/site-packages/torch/lib -lc10 -ltorch_cpu -ltorch -ltorch_python -o cpu_adam.so
/usr/bin/ld: cannot find -lcurand
collect2: error: ld returned 1 exit status
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
  File "/data/miniconda3/envs/env-novelai/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2107, in _run_ninja_build
    subprocess.run(
  File "/data/miniconda3/envs/env-novelai/lib/python3.10/subprocess.py", line 524, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

from deepspeed.

Recommend Projects