Git Product home page Git Product logo

Comments (7)

aarnphm avatar aarnphm commented on August 15, 2024 2

Hey there, #68 will address this isuse. I will do a patch release promptly

from openllm.

aarnphm avatar aarnphm commented on August 15, 2024

what models are you using?

from openllm.

sun7390 avatar sun7390 commented on August 15, 2024

all models,

what models are you using?

when run 'openllm start opt' command,the error occurs

from openllm.

aarnphm avatar aarnphm commented on August 15, 2024

Can you send the whole trace of openllm start opt --debug?

from openllm.

byteshadow avatar byteshadow commented on August 15, 2024
Enabling debug mode for current BentoML session
Error caught while starting LLM Server:
environment can only contain strings
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "C:\Users\b\anaconda3\envs\ol\Scripts\openllm.exe\__main__.py", line 7, in <module>
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\core.py", line 1055, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\core.py", line 760, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\openllm\cli.py", line 381, in wrapper
    return func(*args, **attrs)
           ^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\openllm\cli.py", line 354, in wrapper
    return_value = func(*args, **attrs)
                   ^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\openllm\cli.py", line 329, in wrapper
    return f(*args, **attrs)
           ^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\click\decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\openllm\cli.py", line 837, in model_start
    server.start(env=start_env, text=True, blocking=True)
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\bentoml\server.py", line 190, in start
    return _Manager()
           ^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\site-packages\bentoml\server.py", line 163, in __init__
    self.process = subprocess.Popen(
                   ^^^^^^^^^^^^^^^^^
  File "C:\Users\b\anaconda3\envs\ol\Lib\subprocess.py", line 1024, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "C:\Users\b\anaconda3\envs\ol\Lib\subprocess.py", line 1509, in _execute_child
    hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: environment can only contain strings

from openllm.

aarnphm avatar aarnphm commented on August 15, 2024

can you try OPENLLMDEVDEBUG=3 openllm start opt?

from openllm.

aarnphm avatar aarnphm commented on August 15, 2024

This has been patched in 0.1.14

from openllm.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.