Followed the install, placed a model got this: <div class="snippet-clipboard-conte

Anything else I should check? <div class="snippet-clipboard-content notranslate po

Ok found the issue, had to update this line: <a href="https://github.com/mkellerma

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

Sorry guys, I’m not supporting this. Please check out: <a href="https://github.com

Getting AttributeError: 'Llama' object has no attribute 'ctx' on gpt4all-ui_api_1 about gpt4all-ui HOT 5 CLOSED

mkellerman commented on August 24, 2024

Getting AttributeError: 'Llama' object has no attribute 'ctx' on gpt4all-ui_api_1

from gpt4all-ui.

Comments (5)

jmtatsch commented on August 24, 2024 1

Double check your model path.

from gpt4all-ui.

guysoft commented on August 24, 2024

Anything else I should check?

/tmp/gpt4all-ui$ ls -l models/
total 4114132
-rwxrwxrwx 1 guy guy 4212864640 Apr 23 14:26 gpt4all-lora-unfiltered-quantized.new.bin

from gpt4all-ui.

guysoft commented on August 24, 2024

Ok found the issue, had to update this line:
https://github.com/mkellerman/gpt4all-ui/blob/main/docker-compose.yml#L21

Perhaps it might be a good idea to add in the README in this section:
"Set the docker-compose.yml variable to the correct path of the model you want to use"
?

from gpt4all-ui.

nutmilk10 commented on August 24, 2024

@guysoft what was the path that you updated the yml file with?

gpt4all-ui-chatgpt-1 | ready - started server on 0.0.0.0:3000, url: http://localhost:3000 gpt4all-ui-api-1 | error loading model: unexpectedly reached end of file gpt4all-ui-api-1 | llama_init_from_file: failed to load model

from gpt4all-ui.

mkellerman commented on August 24, 2024

Sorry guys, I’m not supporting this. Please check out:
https://github.com/go-skynet/LocalAI/tree/master/examples/chatbot-ui

from gpt4all-ui.

Recommend Projects