Git Product home page Git Product logo

Comments (4)

josStorer avatar josStorer commented on May 29, 2024

cd到RWKV-Runner的目录下再运行看看

from rwkv-runner.

PJ-568 avatar PJ-568 commented on May 29, 2024

仍不行。

启动:

cd /home/usrnm/prog/RWKV-Runner/
python3 ./backend-python/main.py --rwkv.cpp > log.txt

载入模型:

cd /home/usrnm/prog/RWKV-Runner/
curl http://127.0.0.1:8000/switch-model -X POST -H "Content-Type: application/json" -d '{"model":"./models/RWKV-5-World-0.1B-v1-20230803-ctx4096-fp16.bin","strategy":"cpu fp32"}'

curl: (52) Empty reply from server

客户端尝试 Chat 后返回:

{
  "error": true,
  "message": "NetworkError when attempting to fetch resource."
}

log:

--- 5.6035778522491455 seconds ---
cyac not found
torch found: /usr/lib/python3.11/site-packages/torch/lib
torch set
Strategy Devices: {'cpu'}
state cache disabled
Using rwkv.cpp, strategy is ignored
Failed to find librwkv.so automatically; you need to find the library and create RWKVSharedLibrary specifying the path to it
Traceback (most recent call last):
  File "/home/usrnm/prog/RWKV-Runner/backend-python/routes/config.py", line 73, in switch_model
    RWKV(model=body.model, strategy=body.strategy, tokenizer=body.tokenizer),
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/usrnm/prog/RWKV-Runner/backend-python/utils/rwkv.py", line 536, in RWKV
    model = Model(model, strategy)
            ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/usrnm/prog/RWKV-Runner/backend-python/rwkv_pip/cpp/model.py", line 8, in __init__
    self.library = rwkv_cpp_shared_library.load_rwkv_shared_library()
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/usrnm/prog/RWKV-Runner/backend-python/rwkv_pip/cpp/rwkv_cpp_shared_library.py", line 443, in load_rwkv_shared_library
    assert False, (f'Failed to find {file_name} automatically; '
AssertionError: Failed to find librwkv.so automatically; you need to find the library and create RWKVSharedLibrary specifying the path to it

INFO:     127.0.0.1:52322 - "POST /switch-model HTTP/1.1" 500 Internal Server Error
INFO:     2a06:98c0:3600::103:0 - "POST /v1/chat/completions?path=v1%2Fchat%2Fcompletions HTTP/1.1" 400 Bad Request
INFO:     2a06:98c0:3600::103:0 - "POST /v1/chat/completions?path=v1%2Fchat%2Fcompletions HTTP/1.1" 400 Bad Request
INFO:     2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO:     2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO:     2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO:     2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO:     2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK
INFO:     213.180.203.99:0 - "GET /robots.txt HTTP/1.1" 404 Not Found
INFO:     213.180.203.73:0 - "GET / HTTP/1.1" 200 OK
INFO:     2a06:98c0:3600::103:0 - "GET / HTTP/1.1" 200 OK

from rwkv-runner.

PJ-568 avatar PJ-568 commented on May 29, 2024

我注意到在未运行 curl http://127.0.0.1:8000/switch-model -X POST -H "Content-Type: application/json" -d '{"model":"./models/RWKV-5-World-0.1B-v1-20230803-ctx4096-fp16.bin","strategy":"cpu fp32"}' 情况下 ./backend-python/main.py 就已输出上述 log 。

from rwkv-runner.

josStorer avatar josStorer commented on May 29, 2024

你用下screen或者tmux启动服务

from rwkv-runner.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.