Comments (8)
casjyhq
commented on May 23, 2024
介绍中最低要求是3090，T.T
from moss.
ninerui
commented on May 23, 2024
现在开放的是fp16模型， 是需要30g显存，之后会开放量化的
from moss.
2132660698
commented on May 23, 2024
目前跑起来需要的显存，给大家参考。
from moss.
milk-bottle-liyu
commented on May 23, 2024
我用的4张titan xp，就是比较慢。。。
from moss.
YYGe01
commented on May 23, 2024
目前跑起来需要的显存，给大家参考。
兄弟，我有两张40G的 A100，能跑起来嘛
from moss.
casjyhq
commented on May 23, 2024
啊 这配置要求真高啊
from moss.
lwh9346
commented on May 23, 2024
我用的是单张4080
#35
from moss.
txsun1997
commented on May 23, 2024
@casjyhq @YYGe01 各精度模型推理所需显存已经更新到README
from moss.
Related Issues (20)
- 求邀请码
- finetune的时候为何没有把<|Human|>的loss给mask掉？
- 微信群聊过期了
- moss-003-sft-plugin-data里面有很多错误
- 两张v100部署失败 HOT 2
- RuntimeError: indices should be either on cpu or on the same device as the indexed tensor (cuda:1) HOT 1
- 这是小时候的550W吗 HOT 1
- langchain+moss
- how to continue pretrain?
- export CUDA_LAUNCH_BLOCKING=1 Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.
- 请问moss-003-pm-data偏好数据什么时间能开源？ HOT 2
- how to run fnlp/moss-base-7b in multi gpus
- do_sample=True
- MOSS next release? HOT 3
- 你好，我想知道moss能否采用别的gpu调试 HOT 1
- 想问下moss的多轮sft数据是怎么制作出来的 HOT 1
- 你好，我有一个很有意思的想法。能不能提供帮助 HOT 3
- 多轮对话数据构造的时候是否会有上下文不一致的问题
- moss-moon-003-sft Jupyter测试失败 HOT 2
- moss为什么不更新了
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from moss.