Update README.md
Browse files
README.md
CHANGED
|
@@ -46,6 +46,8 @@ These are NEO Imatrix GGUFs, NEO dataset by DavidAU.
|
|
| 46 |
|
| 47 |
NEO dataset improves overall performance, and is for all use cases.
|
| 48 |
|
|
|
|
|
|
|
| 49 |
TWO example output below (creative), using settings below.
|
| 50 |
|
| 51 |
Model also passed "hard" coding test too (4 experts); no issues (IQ4_NL).
|
|
|
|
| 46 |
|
| 47 |
NEO dataset improves overall performance, and is for all use cases.
|
| 48 |
|
| 49 |
+
This model can be run on cpu, gpu or partial offload, with total of 4 experts (of 128) activated by default ; which is about 5B parameters.
|
| 50 |
+
|
| 51 |
TWO example output below (creative), using settings below.
|
| 52 |
|
| 53 |
Model also passed "hard" coding test too (4 experts); no issues (IQ4_NL).
|