Comments (4)
awni
commented on July 3, 2024
Looks to me like it failed to build mlx.
Can you try python -c "import mlx.core as mx; print(mx.__version__)"?
I don't know why the mlx package is not available. Maybe you can share more on how you built it?
from mlx-examples.
chimezie
commented on July 3, 2024
This is how I built mlx (after pulling changes from git/main):
% env MACOSX_DEPLOYMENT_TARGET=14.2.1 CC=gcc CXX=g++ SDKROOT=`xcrun --show-sdk-path` CMAKE_BUILD_PARALLEL_LEVEL="" pip install .
[..]
Building wheel for mlx (pyproject.toml) ... done
Created wheel for mlx: filename=mlx-0.4.0.dev20240223+d729a199-cp311-cp311-macosx_14_0_universal2.whl size=33120117 sha256=e12f205546c293124e9b5b275a26c4fe40eaf81a5fbc62410b345d60a003c36a
Stored in directory: /private/var/folders/4b/bht1mbdj6xd_1jmhss9cmpbw0000gn/T/pip-ephem-wheel-cache-625iz8uh/wheels/93/15/16/01908bf91d03701448751e2fe7ba9e19ef1ac36825365b7470
Successfully built mlx
Installing collected packages: mlx
Attempting uninstall: mlx
Found existing installation: mlx 0.4.0.dev20240223+d729a199
Uninstalling mlx-0.4.0.dev20240223+d729a199:
Successfully uninstalled mlx-0.4.0.dev20240223+d729a199
Successfully installed mlx-0.4.0.dev20240223+d729a199After which I get the following:
% python -c "import mlx.core as mx; print(mx.__version__)"
0.4.0.dev20240223+d729a199I tried building again and get the same error. I'm even able to import mlx.core in the same way as the failing line:
% ipython
Python 3.11.6 (v3.11.6:8b6ee5ba3b, Oct 2 2023, 11:18:21) [Clang 13.0.0 (clang-1300.0.29.30)]
Type 'copyright', 'credits' or 'license' for more information
IPython 8.18.1 -- An enhanced Interactive Python. Type '?' for help.
In [1]: import mlx.core as mx
In [2]: Which makes me think it might be an import resolution issue related to the relative import:
from .convert import convertfrom mlx-examples.
chimezie
commented on July 3, 2024
I was able to build it after removing those unused imports from the top of init.py BTW:
% git diff
diff --git a/llms/mlx_lm/__init__.py b/llms/mlx_lm/__init__.py
index 8296042..311f216 100644
--- a/llms/mlx_lm/__init__.py
+++ b/llms/mlx_lm/__init__.py
@@ -1,4 +1 @@
-from .convert import convert
-from .utils import generate, load
-
__version__ = "0.0.14"from mlx-examples.
awni
commented on July 3, 2024
Yes, I see the problem. The fix is in #479
from mlx-examples.
Related Issues (20)
- Error when running inference on newly converted OpenELM MLX model, ValueError(f"Received parameters not in model: {extras}.") HOT 1
- LLMEvaluator : libc++abi: terminating due to uncaught exception of type std::invalid_argument: [matmul] Last dimension of first input with shape (1,916,2048) must match second to last dimension of second input with shape (256,32000)
- Unable to allocate memory
- Proposal: Add mypy to .pre-commit-config.yml HOT 2
- Fusing adapters with llama3 cause bad performances HOT 7
- Struggling to convert models to MLX HOT 2
- mlx_lm stops generating HOT 1
- lora resume error HOT 2
- Error loading GGUF Mixtral 8x7B Q_8 model HOT 1
- iterate_batches in mlx_lm's Lora trainer is discarding the remainder dataset items (modulo batch size) HOT 1
- 01-ai/Yi-6B-Chat got IndexError: list assignment index out of range HOT 2
- [Feature Request] Finetuning Scripts for Whisper Models HOT 1
- Feature Request - Beam Search Decoder
- Discrepancies in generations from the fine tuned models after and before converting them into GGUF. The output generations go into an infinite loop. HOT 5
- NameError: name 'resume_adapter_file' is not defined HOT 1
- Received parameters not in model: {extras}. HOT 1
- support for Gemma 2 HOT 1
- Model type deepseek_v2 not supported. HOT 1
- [Feature Request] Supports fine-tuning of Vision models HOT 1
- Feature Request - Generate function, which returns response and logprobs for the response?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mlx-examples.