Update README.md
Browse files
README.md
CHANGED
|
@@ -25,7 +25,7 @@ GGUF quantizations of [Nanbeige/Nanbeige4.1-3B](https://huggingface.co/Nanbeige/
|
|
| 25 |
| `nanbeige4.1-3b-Q5_K_M.gguf` | Q5_K_M | 2.7 GB | High quality |
|
| 26 |
| `nanbeige4.1-3b-Q4_K_M.gguf` | Q4_K_M | 2.3 GB | Good quality, recommended for most users |
|
| 27 |
| `nanbeige4.1-3b-Q3_K_M.gguf` | Q3_K_M | 1.9 GB | Medium quality |
|
| 28 |
-
| `nanbeige4.1-3b-Q2_K.gguf` | Q2_K | 1.6 GB | Smallest size, lower quality (report of constantly stuck in a loop)|
|
| 29 |
|
| 30 |
## Usage
|
| 31 |
|
|
|
|
| 25 |
| `nanbeige4.1-3b-Q5_K_M.gguf` | Q5_K_M | 2.7 GB | High quality |
|
| 26 |
| `nanbeige4.1-3b-Q4_K_M.gguf` | Q4_K_M | 2.3 GB | Good quality, recommended for most users |
|
| 27 |
| `nanbeige4.1-3b-Q3_K_M.gguf` | Q3_K_M | 1.9 GB | Medium quality |
|
| 28 |
+
| `nanbeige4.1-3b-Q2_K.gguf` | Q2_K | 1.6 GB | Smallest size, lower quality (received report of constantly stuck in a loop)|
|
| 29 |
|
| 30 |
## Usage
|
| 31 |
|