Comments (5)
which model are you trying to load?
from modelscope.
gpt3
from modelscope.
currently there are some specical requirements for larger gpt3 models, plesae refer to instrcution on model card, such as
https://www.modelscope.cn/models/damo/nlp_gpt3_text-generation_1.3B/summary
============================
依赖安装
要使用中文GPT3进行推理,需要额外安装DeepSpeed依赖,推荐使用0.7.2版本。另外,我们将GPT3模型依赖的megatron相关代码打包到了单独的包中,以上两个包通过以下命令进行安装:
`pip install deepspeed==0.7.2
pip install megatron_util -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html`
from modelscope.
感谢回复,我去尝试一下!
from modelscope.
clse as resolved
from modelscope.
Related Issues (20)
- 内网微调,检查基础模型文件及版本带来的调用超时过长 HOT 4
- 'model_id' extra fields not permitted | langchain embedding HOT 4
- Setting a different folder for c:/users/xxx/.cache/modelscope ? HOT 1
- 希望给数据集也添加深度重启功能 HOT 2
- gpu跑paraformer larger onnx模型时候,模型内部出现维度不匹配错误 HOT 3
- TTS流式合成功能的需求 HOT 1
- py_sound_connect无法安装 HOT 1
- py_sound_connect无法安装 HOT 1
- question about installing modelscope from source using setup.py HOT 1
- 页面下载文件提示的指令错误 HOT 1
- 训练好的模型加载出错 HOT 1
- 1.15版本存在问题 HOT 19
- 限制GPU显存占用 HOT 2
- MsDataset.load报错 HOT 1
- 安装audio报错 HOT 1
- 已经有音频和对应的文本,如何使用run_auto_label实现音素标注呢? HOT 3
- modelscope 的 dataset、model和space 目前不支持个人仓库移交给组织的功能么? HOT 2
- 希望datasets提供造成viewer不显示的debug logs查看接口 HOT 4
- FileNotFoundError: Cannot find dataset meta-files, please fetch meta from modelscope hub. HOT 1
- 对训练好的模型微调时报错:RuntimeError: probability tensor contains either `inf`, `nan` or element < 0 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from modelscope.