mps256 / vicuna.ps1 Goto Github PK

Failed to open logfile 'main.log' with error 'Permission denied'
[1698425118] Log start
[1698425118] Cmd: C:\VICUNA\llama.cpp\main.exe -i --interactive-first -r "### Human:" -t 8 --temp 0 --color -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m C:\VICUNA\ggml-vicuna-13b-4bit.bin
[1698425118] main: build = 1431 (c8d6a1f)
[1698425118] main: built with MSVC 19.35.32217.1 for x64
[1698425118] main: seed = 1698425118
[1698425118] main: llama backend init
[1698425118] main: load the model and apply lora adapter, if any
gguf_init_from_file: invalid magic characters tjgg.
error loading model: llama_model_loader: failed to load model from C:\VICUNA\ggml-vicuna-13b-4bit.bin

llama_load_model_from_file: failed to load model
llama_init_from_gpt_params: error: failed to load model 'C:\VICUNA\ggml-vicuna-13b-4bit.bin'
[1698425118] main: error: unable to load model
Press any key to continue . . .

I'm sure you are working on it already. Just want to encourage you with this issue!
https://huggingface.co/eachadea/ggml-vicuna-7b-4bit

Thank you for making this!

That would be simply great!

Will this have Linux support soon?

On PC PowerShell script placed main.exe into folder C:\VICUNA\llama-master-master-cc9cee8--x64\main.exe but vicuna.bat is expected at C:\VICUNA\main.exe

like this :"
mian : seed = 1681381082
press any key to continue...
"