mlx-community

/

Ministral-3-3B-Instruct-2512

like 0

Follow

MLX Community 7.54k

I get the following error when trying to run the snippet from the model card:

Fetching 8 files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:00<00:00, 109655.01it/s]
Traceback (most recent call last):
  File "/Users/trettstadt/IdeaProjects/mlx-lm/mlx_lm/examples/test.py", line 3, in <module>
    model, tokenizer = load("mlx-community/Ministral-3-3B-Instruct-2512")
                       ~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/trettstadt/IdeaProjects/mlx-lm/mlx_lm/examples/.venv/lib/python3.14/site-packages/mlx_lm/utils.py", line 326, in load
    tokenizer = load_tokenizer(
        model_path, tokenizer_config, eos_token_ids=config.get("eos_token_id", None)
    )
  File "/Users/trettstadt/IdeaProjects/mlx-lm/mlx_lm/examples/.venv/lib/python3.14/site-packages/mlx_lm/utils.py", line 279, in load_tokenizer
    return _load_tokenizer(
        model_path, tokenizer_config_extra, eos_token_ids=eos_token_ids
    )
  File "/Users/trettstadt/IdeaProjects/mlx-lm/mlx_lm/examples/.venv/lib/python3.14/site-packages/mlx_lm/tokenizer_utils.py", line 463, in load
    AutoTokenizer.from_pretrained(model_path, **kwargs),
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/trettstadt/IdeaProjects/mlx-lm/mlx_lm/examples/.venv/lib/python3.14/site-packages/transformers/models/auto/tokenization_auto.py", line 1153, in from_pretrained
    raise ValueError(
        f"Tokenizer class {tokenizer_class_candidate} does not exist or is not currently imported."
    )
ValueError: Tokenizer class TokenizersBackend does not exist or is not currently imported.

My virtual env contains the following packages after doing a pip install mlx-lm: MarkupSafe-3.0.3 certifi-2025.11.12 charset_normalizer-3.4.4 filelock-3.20.0 fsspec-2025.12.0 hf-xet-1.2.0 huggingface-hub-0.36.0 idna-3.11 jinja2-3.1.6 mlx-0.30.0 mlx-lm-0.28.4 mlx-metal-0.30.0 numpy-2.3.5 packaging-25.0 protobuf-6.33.1 pyyaml-6.0.3 regex-2025.11.3 requests-2.32.5 safetensors-0.7.0 sentencepiece-0.2.1 tokenizers-0.22.1 tqdm-4.67.1 transformers-4.57.3 typing-extensions-4.15.0 urllib3-2.6.0

Any ideas?