Mixtral example is giving non-sensical output about mlx-examples HOT 18 CLOSED

parser.add_argument(
        "--prompt",
        help="The message to be processed by the model",
        default="In the beginning the Universe was created.",
    )

python mixtral.py --model_path ../../mixtral/ -m 2000 --prompt " [INST] {keep continuing the following story. In the beginning the Universe was created.} [/INST] "
[INFO] Loading model from disk.
[INFO] Starting generation...
 [INST] {keep continuing the following story. In the beginning the Universe was created.} [/INST]  [INST] {
For a long time I have wanted to create a detailed, scientific model of the Universe, that would be based on very few assumptions, but that would also explain all known astronomical parameters and observations in as much detail as possible. } [/INST]  <hr>Quote: Savan: I rushed home after work yesterday with the threat of vacation hanging over me, and wrote up a nice description of the background and purpose of the model. But when it came time to save, it crapped out all over my shoes. All I have managed to keep on record is a very short and incomplete description of the background, purpose, and details of the model. Below is all I have managed to save, and I am not sure how much of this is actually useful. What I would actually like to present is the piece of writing that I finished yesterday, but all my attempts to save it have failed. My computer crashed on me during an import procedure involved with an attempt to save the document to my computer's hard drive:
Quote: I have to import a Peek 7.0 Preference file before I try to save the "Crosstalk" thing again next time. Please wait while I finish this import procedure. I wonder what the Peek 7.0 Preference file looks like. I have to import a Peek 7.0 Preference file in order to save the "Crosstalk" thing again next time. Please wait while I finish this import procedure. I wonder what the Peek 7.0 Preference file looks like. I want it! I want it! It wants me! It wants me! I hate it! I hate it! It hates me! It hates me! It conflicts with me! It conflicts with me! There is insufficient system memory to perform this import procedure. There is a system disk error that is causing this import procedure to fail. The disk that was attached to this computer's floppy disk drive interfaced disk controller read interface has timed out because it cannot read any data from the disk quickly enough (because the disk access speeds are too slow) in order to satisfy the minimum manufacturer's specified recommended optimal mandatory minimum safe minimum practical realistically acceptable minimum effective minimum dimensionally satisfactory dimensionally appropriate realistically acceptable nominal minimum effective dimensionally satisfactory dimensionally appropriate realistically acceptable nominal minimum volumes amounts quantities numbers at positions latitudes longitudes altitudes curtain heights during curtain hours particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly peculiarly particularly pecularly peculiarly particularly peculiar particular peculiarly peculiarly particularly peculiarly peculiarly peculiarly peculiarly peculiarly peculiarly peculiarly peculiarily peculiarily peculiarly peculiariest peculiarly peculiaryest peculiarly peculiaryest peculiarly peculiarly peculiaryest peculiarly peculiarly peculiaryest peculiarly peculiaryest peculiarly peculiaryest peculiarly peculiaryest peculiarly peculiaryest peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiary est peculiariest partially particularly peculiary peculiary peculiary peculiary particularly particularly particularly particularly particularly particularly particularly particularly particularly particularly peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiary peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest pecul peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest peculiariest pecul_

_: 7/30/03:_: 7/31/03:_: 7/1/03: 4 1/2 2/3 1/4 2/10 3/12 1/5 2/14 9/5 3/10 1/3 8/5 14/6 3/12 27/6 13/11 16/3 18/4 126/43 1/3 2/3 1/2 1/3 1/4 1/6 2/9 1/9 2/11 3/13 4/13 1/26 1/26 1/26 1/26 1/26 1/26 1/14 1/21 1/21 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/21 1/21 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/42 1/6 6/6 4/2 12/2 6/3 4/5 5/2 2/3 3/5 4/11 7/12 1/2 5/4 10/4 15/2 25/2 40/3 72/6 127/2 271/3 211/21 12496/6185 31583

python mixtral.py --model_path ../../mixtral/ -m 2000 --prompt " [INST] {keep continuing the following story. In the beginning the Universe was created.} [/INST] "
[INFO] Loading model from disk.
Traceback (most recent call last):
  File "/Users/sami/C-Gen/Experiments/mlx-examples/mixtral/mixtral.py", line 289, in <module>
    model, tokenizer = load_model(args.model_path)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/sami/C-Gen/Experiments/mlx-examples/mixtral/mixtral.py", line 233, in load_model
    weights = tree_unflatten(list(weights.items()))
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/sami/C-Gen/Experiments/MLX/lib/python3.12/site-packages/mlx/utils.py", line 115, in tree_unflatten
    int(tree[0][0].split(".", maxsplit=1)[0])
        ~~~~^^^
IndexError: list index out of range
$ git log --oneline
a3ecda2 (HEAD -> main, origin/main, origin/HEAD) Merge pull request #107 from ml-explore/hf_mixtral
b863e7c (origin/hf_mixtral) format

python mixtral.py --model_path ../../mixtral-8x7B-v0.1/ -m 500
[INFO] Loading model from disk.
[INFO] Starting generation...
In the beginning the Universe was created. This has made a lot of people very angry and been widely

regarded as a bad move.

Douglus Adams

The Hitchhiker’s Guide to the Universe

The Universe is a very big place. It is so big that it is hard to comprehend. It is so big that it is hard to comprehend how big it is.

The Universe is so big that it is hard to comprehend how big it is.

The Universe is so big that it is hard to comprehend how big it is.

The Universe is so big that it is hard to comprehend how big it is.

The Universe is so big that it is hard to comprehend how big it is.

The Universe is^CTraceback (most recent call last):
  File "/Users/sami/C-Gen/Experiments/mlx-examples/mixtral/mixtra....

python mixtral.py --model_path ~/models/Mixtral-8x7B-v0.1 -m 200 --prompt "keep continuing the following story. In the beginning the Universe was created." --temp 0.0 

keep continuing the following story. In the beginning the Universe was created. This has made a lot of people very angry and been widely regarded as a bad move.

Douglas Adams

The Hitchhiker’s Guide to the Galaxy

The Hitchhiker’s Guide to the Galaxy is a comedy science fiction series created by Douglas Adams. Originally a radio comedy broadcast on BBC Radio 4 in 1978, it was later adapted to other formats, including stage shows, novels, comic books, a 1981 TV series, a 1984 computer game, and 2005 feature film.

The series follows the adventures of hapless Englishman Arthur Dent, who is rescued from Earth moments before it is destroyed to make way for a hyperspace bypass. He travels through the galaxy with his friend Ford Prefect, a human-like alien (and researcher for the eponymous guidebook) who was stranded on Earth five

python mixtral.py --model_path ../../mixtral-8x7B-v0.1 -m 200 --prompt "keep continuing the following story. In the beginning the Universe was created." --temp 0.0
[INFO] Loading model from disk.
[INFO] Starting generation...
keep continuing the following story. In the beginning the Universe was created. This has made a lot of people very angry and been widely

regarded as a bad move.

Doug Adams

The Universe is a big place, perhaps the biggest.

Carl Sagan

The Universe is a big place, perhaps the biggest.

Carl Sagan

The Universe is a big place, perhaps the biggest.

Carl Sagan