Comments (7)
youth123
commented on September 15, 2024
when I git reset --hard b861e92, it can be installed successfully.
But it failed in 9170835, maybe some commit between these commit ids caused.
from fastmoe.
laekov
commented on September 15, 2024
I will look into this next week.
from fastmoe.
laekov
commented on September 15, 2024
What is your PyTorch version? @youth123
from fastmoe.
youth123
commented on September 15, 2024
What is your PyTorch version? @youth123
1.8.0
from fastmoe.
laekov
commented on September 15, 2024
So, the difference is that we check pytorch's version using its macros here in order to be compatible to older PyTorch versions.
Can you check if your pytorch header files correctly define these macros?
from fastmoe.
youth123
commented on September 15, 2024
Sorry to reply so late. My pytorch header files don't have TORCH_VERSION_MAJOR.
from fastmoe.
laekov
commented on September 15, 2024
The macro is defined here in PyTorch 1.8.0. Its absense indicates that your PyTorch may be incorrectly installed.
from fastmoe.
Related Issues (20)
- ImportError: cannot import name 'get_args' from 'megatron' HOT 5
- setup.py error！ HOT 4
- pytest error HOT 3
- 开启Smart schedule时报错Segmentation fault HOT 8
- num_experts argument error for Megatron-LM
- 你好，我想请问下在fastmoe中如何定义 dp+mp下的moe HOT 6
- 我们有线上沟通的群吗 HOT 1
- prep_text8.py没有该脚本 HOT 1
- 请问fastmoe能被集成到VLLM里吗 HOT 4
- fastmoe是否支持微调，page-attention，flasahattention和kvcache，混合精度等 HOT 4
- fastmoe支持微调吗
- 跑FMOE的时候提示cudaErrorInvalidDevice HOT 6
- [BUG] AttributeError: module 'fmoe_cuda' has no attribute 'assign_pos_' HOT 3
- Example to run Megatron HOT 3
- multi-node problem HOT 1
- About switch_gate HOT 1
- A bug in switch_gate HOT 6
- CUDA memory increases after each loss.backward() HOT 6
- DDP error
- FasterMoE Shadow Policy: Detailed Inquiry HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fastmoe.