Comments (8)
Hey, I have been trying to get this to work on Windows myself, but I am not sure how. If it is no bother, could you make a tutorial?
Thank you for your time!
from alpaca.cpp.
This actually only occurs for debug! Whoops. still an issue though. I just built with release since i've been accidentally building wrong this whole time. It's so much faster. Will keep open cuz maybe it's something?
from alpaca.cpp.
@InfernalDread I have PR'd a Windows install guide to the readme, you can check it here #26
from alpaca.cpp.
@mcmonkey4eva That is great! Thank you very much! I will try it soon!
from alpaca.cpp.
the segfault might be related to #18 just in case
from alpaca.cpp.
Just wanted to update, the suggested windows installation tutorial that @mcmonkey4eva has supplied has worked for me as well. Once again, thank you!
from alpaca.cpp.
anyone find a fix for this in Windows 10?
This seems to be a source level bug. Seemly relying on how the compiler handles a back() call on an empty vector?
from alpaca.cpp.
I tracked down the empty std::vector back() call assert generated by a 2nd input prompt.
The issue in is line 1078 in chat.cpp. embd is an empty vector and the code is attempting to assign a value to an element which doesn't exist.
if (embd.back() == 2 ) {
I put a empty vector check for the variable embd before this line executed called to avoid the assert but doing it causes every other input prompt to be ignored.
if (embd.size() == 0) { embd.push_back(2); }
Maybe someone with more time or savvy can figure out why this bug only appears when running in Windows (10?). I'm using the latest version of Visual Studio 2022 (17.5.2) to compile it.
from alpaca.cpp.
Related Issues (20)
- windows 10, fails to get to chat prompt HOT 8
- Issues with Monte Carlo Tree Search on alpaca.cpp
- CUDA support? HOT 3
- Input Handling HOT 1
- Segmentation Fault with 7b on Raspberry Pi 3 HOT 5
- ### Instruction: ### Response: HOT 3
- Random seed not working correctly, "too many inputs", chinese symbols?
- How to use with python HOT 1
- Can i use it on linux with nvidia gpu HOT 4
- minimum specs
- Does not perceive other languages HOT 5
- Are there any plans to add support for 13B and beyond? HOT 7
- Running very slow HOT 7
- Redpajama dataset?
- using ggml-alpaca-13b-q4.bin HOT 1
- Archive Repository HOT 1
- main: failed to load model from 'ggml-alpaca-7b-q4.bin' HOT 4
- llama_model_load: failed to open 'ggml-alpaca-7b-native-q4.bin' HOT 1
- HuggingFaceH4/starchat-alpha Cpp LLM
- Adding risc-v architecture support HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alpaca.cpp.