Readme tweaks (#5)
Browse files- Readme tweaks (57642a0f98520fdf8891310b3adfbcbb9042e79a)
README.md
CHANGED
|
@@ -69,16 +69,14 @@ The MoE router gates (`mlp.gate` and `mlp.shared_expert_gate` for all 60 layers)
|
|
| 69 |
|
| 70 |
## Requirements
|
| 71 |
|
| 72 |
-
- Apple Silicon Mac with **at least 256 GB unified memory** (e.g., Mac Studio
|
| 73 |
- Python 3.10+
|
| 74 |
-
- [`mlx-lm`](https://github.com/ml-explore/mlx-lm)
|
| 75 |
-
|
| 76 |
-
> **Note**: Although only ~17B parameters are active per token, all 397B parameters (~223 GB quantized) must be loaded into unified memory.
|
| 77 |
|
| 78 |
## Installation
|
| 79 |
|
| 80 |
```bash
|
| 81 |
-
pip install mlx-lm
|
| 82 |
```
|
| 83 |
|
| 84 |
## Usage
|
|
|
|
| 69 |
|
| 70 |
## Requirements
|
| 71 |
|
| 72 |
+
- Apple Silicon Mac with **at least 256 GB unified memory** (e.g., Mac Studio M3 Ultra 256GB+)
|
| 73 |
- Python 3.10+
|
| 74 |
+
- [`mlx-lm`](https://github.com/ml-explore/mlx-lm) from the `main` branch
|
|
|
|
|
|
|
| 75 |
|
| 76 |
## Installation
|
| 77 |
|
| 78 |
```bash
|
| 79 |
+
pip install git+https://github.com/ml-explore/mlx-lm
|
| 80 |
```
|
| 81 |
|
| 82 |
## Usage
|