Server is not working on windows yet about gpt-llama.cpp HOT 19 CLOSED

Ok, I have turned back on my PC, lets do this!

from gpt-llama.cpp.

can u screenshot what u see? also is anything printed in the terminal? thank u!

from gpt-llama.cpp.

from gpt-llama.cpp.

interesting.. can you make sure you run npm i again to install dependencies?
also, what do you get if you try to visit localhost:443/v1/models

from gpt-llama.cpp.

I will try that now.

from gpt-llama.cpp.

Same result for both sadly

from gpt-llama.cpp.

that is odd.. do you see any issues in the cmd window?

can you try instead of localhost use your ip address (192.168.0.33:443)

does going to localhost:443 even give you anything? it almost seems like the server isn't running at all..

from gpt-llama.cpp.

I can try that. I agree with you though, its almost like the server isn't running lol

from gpt-llama.cpp.

Nothing. No issues in the cmd window either, no errors or odd things showing up at all. Odd indeed.

from gpt-llama.cpp.

hmmmmmmm.. maybe try opening a new terminal and trying agin? or restarting ur pc? this gotta be the weirdest issue i've seen haha

from gpt-llama.cpp.

I guess I can try that too, lets hope for the best! In the meantime, is there any code that you are using that is specific to apple hardware? Or is everything "universally" supported?

from gpt-llama.cpp.

i wouldn't think that the issue you're seeing would be due to windows vs mac. i asked chatgpt and it has a couple good suggestions

1. Make sure your server is actually running and listening on port 443. You can check this by running netstat -an | findstr :443 in your command prompt or terminal. This command will list all the active network connections and you should see a line with 127.0.0.1:443 or 0.0.0.0:443 indicating that your server is listening on port 443.

(i see TCP [::]:443 [::]:0. LISTENING for the server)

2. Check your firewall settings to make sure that port 443 is open and not blocked. You can try temporarily disabling your firewall to see if that resolves the issue.

Maybe port 443 is blocked. try changing the PORT to something other than 443 in index.js (line 11), maybe try 8000?

const PORT = 8000;

from gpt-llama.cpp.

Lets gooo. Thank you for the assistance! Do I need to do anything with the docs? Or are the next steps specific to other programs that utilize this api?

from gpt-llama.cpp.

lets gooo!!!! what was the solution? was it because of the :443 port or did the restart do the job?

docs are a good place to test out the api (you NEED to "AUTHORIZE" for any of the endpoints to work, just throw in the path to the model in there), but otherwise you can start by trying out chatbot-ui's guide (only one i've written so far lol) https://github.com/keldenl/gpt-llama.cpp/blob/master/docs/chatbot-ui-setup-guide.md

from gpt-llama.cpp.

Ya, the restart did the trick. How do I authorize? I tried to look into the steps, but I am not too tech savvy lol

EDIT: I have a Vicuna 13B ggml bin file ready to go

from gpt-llama.cpp.

from gpt-llama.cpp.

Ohhhhh, man, please excuse my stupidity LOL

from gpt-llama.cpp.

u are good haha

from gpt-llama.cpp.

i'm going to go ahead and close this as resolved! tl;dr if anybody else in the future hits this – doesn't seem to be windows specific and a computer restart or cmd window restart should do the trick! thanks!

from gpt-llama.cpp.