Comments (5)
Hi @xalteropsx - looks like you are trying to install on Windows. Have you followed the Windows batch script here?
CC: @costin-eseanu
from deepspeed.
is this work on rx 7900 xtx ? not tried the window batch script yet
from deepspeed.
is this work on rx 7900 xtx ? not tried the window batch script yet
I'm not sure, we only have officially tested on AMD MI100 and MI200, it may work, it will depend on the ROCm support, but if you need to install on Windows, you'll need to either use WSL to the Windows batch script to ensure the correct ops are built.
from deepspeed.
sorry for late response bro @loadams seems like it not gonna work with window unless wsl but i dont like wsl
so triton is still on linux not on window
from deepspeed.
@xalteropsx - could you share more info on what errors you are hitting when using the updated windows batch script install? That way we can work on fixing that? cc: @costin-eseanu
from deepspeed.
Related Issues (20)
- Fail to use zero_init to construct llama2 with deepspeed zero3 and bnb!
- does DeepSpeed support AMSP (a new DP shard strategy)
- [BUG] 'Invalidate trace cache' with Seq2SeqTrainer+predict_with_generate+Zero3
- AssertionError: Unable to pre-compile ops without torch installed. Please install torch before attempting to pre-compile ops. HOT 6
- How to set different learning rates for different parameters of LLMs
- Getting parameters of embeddings (safe_get_local_fp32_param)and setting the weight of embeddings (safe_set_local_fp32_param) does not work (bug?). HOT 1
- [BUG] DeepSpeed on pypi not compatible with latest `numpy` HOT 5
- [BUG] GPU memory leaking after deleting deepspeed engine HOT 2
- [BUG] Using and Building DeepSpeedCPUAdam HOT 23
- Bug Report: Issues Building DeepSpeed on Windows HOT 4
- [BUG] Logs full of FutureWarning when training with nightly PyTorch HOT 1
- [BUG] inference ValueError
- Running out of CPU memory. Dataset is loaded for each created process
- [ERROR] [launch.py:321:sigkill_handler] exits with return code = -11
- [BUG] Regression: 0.14.3 causes grad_norm to be zero HOT 1
- [BUG] Deepspeed does not seem to work using GPUDirect, should it? HOT 3
- I am not able to reproduce it. May be I am missing some details. Can you please give me the exact steps & set up you followed?
- Tensor(hidden states)missing across GPU in Pipeline Parallelism Training[BUG]
- [REQUEST]win10 install fail build_win.bat HOT 2
- [BUG] Mixed-precision: fp16 will cast input_ids into torch.cuda.HalfTensor instead of Long or Int.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from deepspeed.