Update README.md
Browse files
README.md
CHANGED
|
@@ -10,14 +10,14 @@ tags:
|
|
| 10 |
- gguf-connector
|
| 11 |
---
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
|
| 16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
| 17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
| 18 |
|
| 19 |
### how to run it
|
| 20 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
| 21 |
|
| 22 |
-
|
| 23 |
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
|
|
|
|
| 10 |
- gguf-connector
|
| 11 |
---
|
| 12 |
|
| 13 |
+
## gguf quantized and bug fixed version of phi4
|
| 14 |
|
| 15 |
+
### review
|
| 16 |
- bug fixed for: "ResponseError: llama runner process has terminated: GGML_ASSERT(hparams.n_swa > 0) failed"
|
| 17 |
- tq1_0 and tq2_0 are not usable; seems at least should start with q2_k
|
| 18 |
|
| 19 |
### how to run it
|
| 20 |
use any connector for interacting with gguf; i.e., [gguf-connector](https://pypi.org/project/gguf-connector/)
|
| 21 |
|
| 22 |
+
### reference
|
| 23 |
- base model: microsoft/[phi-4](https://huggingface.co/microsoft/phi-4)
|