Comments (3)
参考: https://dataelem.feishu.cn/wiki/KAl2wfI9nippfDktNKdclIIMnKf
部分模型已支持
from bisheng.
按文档操作,.bin的模型上线没问题。上线QWEN-7B,模型文件是.safetensor,出现以下错误:
上线失败,Internal: OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory ./models/model_repository/qwen-7b-chat.
At:
/usr/local/lib/python3.8/dist-packages/transformers/modeling_utils.py(2474): from_pretrained
/usr/local/lib/python3.8/dist-packages/transformers/models/auto/auto_factory.py(488): from_pretrained
/opt/bisheng-rt/./backends/python/pybackend_libs/dataelem/model/llm/llm.py(92): _load
/opt/bisheng-rt/./backends/python/pybackend_libs/dataelem/model/llm/qwen.py(71): init
/opt/bisheng-rt/./resource/internal_model_repository/graphs/huggingface_model/1/model.py(41): initialize
from bisheng.
use_safetensors | str, "1" or "0" , 1表示使用safetenosrs, 0表示不使用 llama2与qwen模型可使用safetensors格式 | “0”, 选填 |
---|
from bisheng.
Related Issues (20)
- ChatZhipuAI 组件异常返回导致页面显示不友好 HOT 1
- 技能上线后使用对话报错:LLM 技能执行错误. error=(pymysql.err.DataError) (1406, \"Data too long for column 'message' at row 1\")\n
- fin_glm实例细节
- 如何重置admin用户的密码?how to reset admin password? HOT 1
- 能否提供一个如何使用VLLM框架已配好的模型后端服务配置CustomLLMChat的详细操作手册呢? HOT 1
- docker-compose up -d启动项目服务时,报错:ERROR: The Compose file './docker-compose.yml' is invalid because: services.office.environment.JWT_ENABLED contains false, which is an invalid type, it should be a string, number, or a null HOT 1
- 当进行批量接口调用时,平台出现崩溃、卡死问题,长时间运行后,处理性能急剧下降 HOT 4
- 平台ws免密接口连接失败 HOT 1
- 未在0卡部署模型,为什么0卡显存占用满了 HOT 1
- llama_index 跟 pydantic v1不兼容,本地启动报错 HOT 2
- 解析知识库文件失败,bishen-backend服务有报错. HOT 1
- 知识库错误 HOT 1
- 知识库连接ElasticKeywordsSearch异常 HOT 4
- Questions about the virtulization of GPU
- 新建流程,执行报错分析出错,Error: add() missing 1 required positional argument: 'b'
- 部署bisheng_unstructured解析文件报错
- MilvusWithPermissionCheck自己创建的知识库没有访问权限会被过滤掉
- Request failed with status code 502 HOT 1
- 新需求【知识文档预览和下载】
- Enhancement Request for User Documentation Clarity
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from bisheng.