Comments (3)
--- 0.8576188087463379 seconds ---
INFO: Started server process [22196]
INFO: Waiting for application startup.
torch found: G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\torch\lib
torch set
INFO: Application startup complete.
INFO: Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit)
INFO: 127.0.0.1:31858 - "GET / HTTP/1.1" 304 Not Modified
INFO: 127.0.0.1:31858 - "GET /status HTTP/1.1" 200 OK
INFO: 127.0.0.1:31858 - "OPTIONS /update-config HTTP/1.1" 200 OK
INFO: 127.0.0.1:31857 - "OPTIONS /switch-model HTTP/1.1" 200 OK
state not loaded
Updated Model Config: max_tokens=4100 temperature=1.0 top_p=0.3 presence_penalty=0.0 frequency_penalty=1.0 penalty_decay=None top_k=None global_penalty=None state=None
INFO: 127.0.0.1:31857 - "POST /update-config HTTP/1.1" 200 OK
Strategy Devices: {'cuda'}
state cache enabled
G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages_distutils_hack_init_.py:11: UserWarning: Distutils was imported before Setuptools, but importing Setuptools also replaces the distutils
module in sys.modules
. This may lead to undesirable behaviors or errors. To avoid these issues, avoid using distutils directly, ensure that setuptools is installed in the traditional way (e.g. not an editable install), and/or make sure that setuptools is always imported before distutils.
warnings.warn(
G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages_distutils_hack_init_.py:26: UserWarning: Setuptools is replacing distutils.
warnings.warn("Setuptools is replacing distutils.")
cannot import name 'packaging' from 'pkg_resources' (G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\pkg_resources_init_.py)
Traceback (most recent call last):
File "G:\AI\RWKV-Runner-Backend\backend-python\routes\config.py", line 73, in switch_model
RWKV(model=body.model, strategy=body.strategy, tokenizer=body.tokenizer),
File "G:\AI\RWKV-Runner-Backend\backend-python\utils\rwkv.py", line 644, in RWKV
from rwkv_pip.model import (
File "G:\AI\RWKV-Runner-Backend\backend-python\rwkv_pip\model.py", line 84, in
from torch.utils.cpp_extension import load
File "G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\torch\utils\cpp_extension.py", line 25, in
from pkg_resources import packaging # type: ignore[attr-defined]
ImportError: cannot import name 'packaging' from 'pkg_resources' (G:\AI\RWKV-Runner-Backend\py310\Lib\site-packages\pkg_resources_init_.py)
INFO: 127.0.0.1:31858 - "POST /switch-model HTTP/1.1" 500 Internal Server Error
from rwkv-runner.
AUTOMATIC1111/stable-diffusion-webui#15863
./py310/python -m pip install setuptools==69.5.1
from rwkv-runner.
解决了,谢谢
from rwkv-runner.
Related Issues (20)
- CPU/CPU(rwkv.cpp) 模型切换问题 HOT 1
- 调用api接口感觉速度有点慢,是否和流式输出有关系,我看接口记录中流式输出参数是false,这个"stream": false, 参数在哪里可以设置呢? HOT 7
- 大佬,有兴趣加入Mirostat采样器吗? HOT 1
- 如何完全卸载呢? HOT 1
- 希望重新生成之前的对话时不会自动滚动到最后一段聊天
- JosStorer君,下载的东西都默认下载到C盘了。文件夹我是放到D盘的 HOT 1
- 模型运行成功,但发的所有消息都显示network error,控制台显示报错。 HOT 2
- 微调功能在上月新发布的 ubuntu 24.04 下失败
- 是否能够进行多batch的推理?
- install from source requirement.txt error on pkgutil
- 显卡能使用计算卡吗? HOT 2
- 最新的rwkv-6-world模型转换后运行出错 HOT 1
- 因为ImportError: cannot import name 'packaging' from 'pkg_resources'导致模型转换失败 HOT 2
- 请教GPU负载均衡的问题 HOT 2
- lora微调训练问题 HOT 1
- linux部署的时候换一个rwkv模型无法运行
- Linux服务器的webGPU并行问题 HOT 1
- ERROR: Could not find a version that satisfies the requirement torch==1.13.1 (from versions: none) ERROR: No matching distribution found for torch==1.13.1
- RWKV依赖错误
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rwkv-runner.