Comments (3)
Unfortunately, this did not work for me in M1.
When you first run nxp dalai llama
, it clones the llama.cpp
repo to your home directory.
You need to remove the llama.cpp
folder for the virtualenv
solution to work.
from dalai.
Unfortunately, this did not work for me in M1.
@mrafaeldie12 Not sure how you mean by not work. I was able to get past at least the installation by leveraging pipenv
:
% pipenv --python 3.10
% pipenv run npx dalai llama
This will force the Dalai
constructor to "inherit" from the virtualenv initiated by pipenv
, effectively also bypassing the need for the following commented by @alexthehurst:
Thanks for the tip! On macOS, this didn't work for me until I patched
cli.js
to callnew Dalai('~/dalai-venv-py310').install(...
instead of calling the constructor with no args. Dalai looks for Python and Pip at this path.
I'm leaving this to download and will confirm if the inference actually runs on M1 later when I get back
Edit (2023-Mar-14):
Confirmed that the inference works (but quite slow and unreliable) on an M1 machine
from dalai.
Thanks for the tip! On macOS, this didn't work for me until I patched cli.js
to call new Dalai('~/dalai-venv-py310').install(...
instead of calling the constructor with no args. Dalai looks for Python and Pip at this path.
from dalai.
Related Issues (20)
- "npx dalai llama install 7B" fails with "./quantize : The term './quantize' is not recognized" HOT 1
- Dalai server doesn't start without internet connection HOT 1
- Possible solution for Windows users - LLama not working. HOT 4
- Low CPU, Low Memory, Low GPU usage via Docker HOT 3
- Typo in README.md HOT 1
- llama_model_load: loading model issue in Docker HOT 5
- Docker compose never responds HOT 5
- [EndeavorOS] model hangs
- can't install HOT 7
- any way this can run Falcon?
- silent fail in llama/main HOT 1
- Support for Llama-2? HOT 4
- Error installing llama using docker compose (logs attached) HOT 1
- Alpaca doesn't respond HOT 1
- boucle inf on javascript call to Dalai
- Does not work on Windows 11 or Linux Mint Cinnamon HOT 1
- llama 7B is talking jibberish. Does not respond intelligently to my command.
- On Mac OS, I got this error
- On Mac, Alpaca is stuck. Did I uninstall correctly?
- Models repository HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dalai.