Comments (7)
same because i cant download it because of an error that has to do with quantize. you probably have the same issue. the file is still unpacked or something it looks like on my end.
from dalai.
Same error here with Windows and WSL
from dalai.
The error mentioned above is:
exec: make in C:\Users\XXX\llama.cpp
Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.
Install the latest PowerShell for new features and improvements! https://aka.ms/PSWindows
PS C:\Users\XXX\llama.cpp> make
process_begin: CreateProcess(NULL, uname -s, ...) failed.
Makefile:2: pipe: No error
process_begin: CreateProcess(NULL, uname -p, ...) failed.
Makefile:6: pipe: No error
process_begin: CreateProcess(NULL, uname -m, ...) failed.
Makefile:10: pipe: No error
'cc' is not recognized as an internal or external command,
operable program or batch file.
'g++' is not recognized as an internal or external command,
operable program or batch file.
I llama.cpp build info:
I UNAME_S:
I UNAME_P:
I UNAME_M:
I CFLAGS: -I. -O3 -DNDEBUG -std=c11 -fPIC -mfma -mf16c -mavx -mavx2
I CXXFLAGS: -I. -I./examples -O3 -DNDEBUG -std=c++11 -fPIC
I LDFLAGS:
I CC:
I CXX:
cc -I. -O3 -DNDEBUG -std=c11 -fPIC -mfma -mf16c -mavx -mavx2 -c ggml.c -o ggml.o
process_begin: CreateProcess(NULL, cc -I. -O3 -DNDEBUG -std=c11 -fPIC -mfma -mf16c -mavx -mavx2 -c ggml.c -o ggml.o, ...) failed.
make (e=2): The system cannot find the file specified.
make: *** [Makefile:186: ggml.o] Error 2
PS C:\Users\XXX\llama.cpp> exit
Download model 7B
Skip file download, it already exists: checklist.chk
Skip file download, it already exists: params.json
Skip file download, it already exists: consolidated.00.pth
Skip file download, it already exists: tokenizer_checklist.chk
Skip file download, it already exists: tokenizer.model
Skip conversion, file already exists: C:\Users\XXX\llama.cpp\models\7B\ggml-model-f16.bin
exec: ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2 in C:\Users\XXX\llama.cpp
Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.
Install the latest PowerShell for new features and improvements! https://aka.ms/PSWindows
PS C:\Users\XXX\llama.cpp> ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin 2
./quantize : The term './quantize' is not recognized as the name of a cmdlet,
function, script file, or operable program. Check the spelling of the name, or
if a path was included, verify that the path is correct and try again.
At line:1 char:1
+ ./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0 ...
+ ~~~~~~~~~~
+ CategoryInfo : ObjectNotFound: (./quantize:String) [], CommandN
otFoundException
+ FullyQualifiedErrorId : CommandNotFoundException
from dalai.
I have the same issue, The bin file seem to need unpacking, any one was able to solve this issue ?
from dalai.
Thanks @lofcz ! That was not quite the error I got. Mine had RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory
which I would think is the issue for me.
from dalai.
for me I am missing quantize models
from dalai.
anyone solved this issue?
from dalai.
Related Issues (20)
- "npx dalai llama install 7B" fails with "./quantize : The term './quantize' is not recognized" HOT 1
- Dalai server doesn't start without internet connection HOT 1
- Possible solution for Windows users - LLama not working. HOT 4
- Low CPU, Low Memory, Low GPU usage via Docker HOT 3
- Typo in README.md HOT 1
- llama_model_load: loading model issue in Docker HOT 5
- Docker compose never responds HOT 5
- [EndeavorOS] model hangs
- can't install HOT 7
- any way this can run Falcon?
- silent fail in llama/main HOT 1
- Support for Llama-2? HOT 4
- Error installing llama using docker compose (logs attached) HOT 1
- Alpaca doesn't respond HOT 1
- boucle inf on javascript call to Dalai
- Does not work on Windows 11 or Linux Mint Cinnamon HOT 1
- llama 7B is talking jibberish. Does not respond intelligently to my command.
- On Mac OS, I got this error
- On Mac, Alpaca is stuck. Did I uninstall correctly?
- Models repository HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dalai.