pcuenq HF Staff commited on
Commit
8dae1fa
·
1 Parent(s): 5e50819
Files changed (1) hide show
  1. README.md +3 -5
README.md CHANGED
@@ -69,16 +69,14 @@ The MoE router gates (`mlp.gate` and `mlp.shared_expert_gate` for all 60 layers)
69
 
70
  ## Requirements
71
 
72
- - Apple Silicon Mac with **at least 256 GB unified memory** (e.g., Mac Studio M2/M3/M4 Ultra 256GB+)
73
  - Python 3.10+
74
- - [`mlx-lm`](https://github.com/ml-explore/mlx-lm) v0.30.7 or better
75
-
76
- > **Note**: Although only ~17B parameters are active per token, all 397B parameters (~223 GB quantized) must be loaded into unified memory.
77
 
78
  ## Installation
79
 
80
  ```bash
81
- pip install mlx-lm
82
  ```
83
 
84
  ## Usage
 
69
 
70
  ## Requirements
71
 
72
+ - Apple Silicon Mac with **at least 256 GB unified memory** (e.g., Mac Studio M3 Ultra 256GB+)
73
  - Python 3.10+
74
+ - [`mlx-lm`](https://github.com/ml-explore/mlx-lm) from the `main` branch
 
 
75
 
76
  ## Installation
77
 
78
  ```bash
79
+ pip install git+https://github.com/ml-explore/mlx-lm
80
  ```
81
 
82
  ## Usage