Comments (4)
cd到RWKV-Runner的目录下再运行看看
from rwkv-runner.
仍不行。
启动:
cd /home/usrnm/prog/RWKV-Runner/
python3 ./backend-python/main.py --rwkv.cpp > log.txt
载入模型:
cd /home/usrnm/prog/RWKV-Runner/
curl http://127.0.0.1:8000/switch-model -X POST -H "Content-Type: application/json" -d '{"model":"./models/RWKV-5-World-0.1B-v1-20230803-ctx4096-fp16.bin","strategy":"cpu fp32"}'
curl: (52) Empty reply from server
客户端尝试 Chat 后返回:
{
"error": true,
"message": "NetworkError when attempting to fetch resource."
}
log:
--- 5.6035778522491455 seconds ---
cyac not found
torch found: /usr/lib/python3.11/site-packages/torch/lib
torch set
Strategy Devices: {'cpu'}
state cache disabled
Using rwkv.cpp, strategy is ignored
Failed to find librwkv.so automatically; you need to find the library and create RWKVSharedLibrary specifying the path to it
Traceback (most recent call last):
File "/home/usrnm/prog/RWKV-Runner/backend-python/routes/config.py", line 73, in switch_model
RWKV(model=body.model, strategy=body.strategy, tokenizer=body.tokenizer),
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/usrnm/prog/RWKV-Runner/backend-python/utils/rwkv.py", line 536, in RWKV
model = Model(model, strategy)
^^^^^^^^^^^^^^^^^^^^^^
File "/home/usrnm/prog/RWKV-Runner/backend-python/rwkv_pip/cpp/model.py", line 8, in __init__
self.library = rwkv_cpp_shared_library.load_rwkv_shared_library()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/usrnm/prog/RWKV-Runner/backend-python/rwkv_pip/cpp/rwkv_cpp_shared_library.py", line 443, in load_rwkv_shared_library
assert False, (f'Failed to find {file_name} automatically; '
AssertionError: Failed to find librwkv.so automatically; you need to find the library and create RWKVSharedLibrary specifying the path to it
INFO: 127.0.0.1:52322 - "POST /switch-model HTTP/1.1" 500 Internal Server Error
INFO: 2a06:98c0:3600::103:0 - "POST /v1/chat/completions?path=v1%2Fchat%2Fcompletions HTTP/1.1" 400 Bad Request
INFO: 2a06:98c0:3600::103:0 - "POST /v1/chat/completions?path=v1%2Fchat%2Fcompletions HTTP/1.1" 400 Bad Request
INFO: 2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO: 2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO: 2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO: 2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO: 2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO: 213.180.203.99:0 - "GET /robots.txt HTTP/1.1" 404 Not Found
INFO: 213.180.203.73:0 - "GET / HTTP/1.1" 200 OK
INFO: 2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
from rwkv-runner.
我注意到在未运行 curl http://127.0.0.1:8000/switch-model -X POST -H "Content-Type: application/json" -d '{"model":"./models/RWKV-5-World-0.1B-v1-20230803-ctx4096-fp16.bin","strategy":"cpu fp32"}'
情况下 ./backend-python/main.py
就已输出上述 log 。
from rwkv-runner.
你用下screen或者tmux启动服务
from rwkv-runner.
Related Issues (20)
- 切换.bin模型失败 HOT 6
- Trojans in Windows installer? (multiple detections from VirusTotal) HOT 1
- 我在本地配置了ollama,在聊天和续写时怎么调取? HOT 6
- 希望加入PISSA和LISA微调 HOT 2
- 【新人求助】如果想写小说,有什么模型推荐? HOT 1
- Win10 無法啟動 HOT 4
- CPU/CPU(rwkv.cpp) 模型切换问题 HOT 1
- 调用api接口感觉速度有点慢,是否和流式输出有关系,我看接口记录中流式输出参数是false,这个"stream": false, 参数在哪里可以设置呢? HOT 7
- 大佬,有兴趣加入Mirostat采样器吗? HOT 1
- 如何完全卸载呢? HOT 1
- 希望重新生成之前的对话时不会自动滚动到最后一段聊天
- JosStorer君,下载的东西都默认下载到C盘了。文件夹我是放到D盘的 HOT 1
- 模型运行成功,但发的所有消息都显示network error,控制台显示报错。 HOT 2
- 微调功能在上月新发布的 ubuntu 24.04 下失败
- 是否能够进行多batch的推理?
- install from source requirement.txt error on pkgutil
- 服务启动成功,但是访问报500 HOT 3
- 显卡能使用计算卡吗? HOT 1
- 最新的rwkv-6-world模型转换后运行出错
- 因为ImportError: cannot import name 'packaging' from 'pkg_resources'导致模型转换失败 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rwkv-runner.