Model info updated
Browse files
README.md
CHANGED
|
@@ -6,7 +6,9 @@ tags:
|
|
| 6 |
- llama.cpp
|
| 7 |
- quantized
|
| 8 |
- text-generation
|
| 9 |
-
- reasoning
|
|
|
|
|
|
|
| 10 |
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
|
| 11 |
author: geoffmunn
|
| 12 |
pipeline_tag: text-generation
|
|
@@ -48,10 +50,10 @@ This is a **GGUF-quantized version** of the **[Qwen/Qwen3-Coder-30B-A3B-Instruct
|
|
| 48 |
> π‘ **Recommendations by Use Case**
|
| 49 |
>
|
| 50 |
> - π» **Standard Laptop (i5/M1 Mac)**: Q5_K_M (optimal quality)
|
| 51 |
-
- π§ **Reasoning, Coding, Math**: Q5_K_M or Q6_K
|
| 52 |
-
- π **RAG, Retrieval, Precision Tasks**: Q6_K or Q8_0
|
| 53 |
-
- π€ **Agent & Tool Integration**: Q5_K_M
|
| 54 |
-
- π οΈ **Development & Testing**: Test from Q4_K_M up to Q8_0
|
| 55 |
|
| 56 |
|
| 57 |
## Usage
|
|
|
|
| 6 |
- llama.cpp
|
| 7 |
- quantized
|
| 8 |
- text-generation
|
| 9 |
+
- reasoning
|
| 10 |
+
- agent
|
| 11 |
+
- multilingual
|
| 12 |
base_model: Qwen/Qwen3-Coder-30B-A3B-Instruct
|
| 13 |
author: geoffmunn
|
| 14 |
pipeline_tag: text-generation
|
|
|
|
| 50 |
> π‘ **Recommendations by Use Case**
|
| 51 |
>
|
| 52 |
> - π» **Standard Laptop (i5/M1 Mac)**: Q5_K_M (optimal quality)
|
| 53 |
+
> - π§ **Reasoning, Coding, Math**: Q5_K_M or Q6_K
|
| 54 |
+
> - π **RAG, Retrieval, Precision Tasks**: Q6_K or Q8_0
|
| 55 |
+
> - π€ **Agent & Tool Integration**: Q5_K_M
|
| 56 |
+
> - π οΈ **Development & Testing**: Test from Q4_K_M up to Q8_0
|
| 57 |
|
| 58 |
|
| 59 |
## Usage
|