mlx-community
/

Qwen3-14B-4bit-AWQ

Text Generation

4-bit precision

Model card Files Files and versions

sudo-0x2a commited on Jun 2

Commit

17ddb26

·

1 Parent(s): 1e6f290

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -14,6 +14,8 @@ This model [mlx-community/Qwen3-14B-4bit-AWQ](https://huggingface.co/mlx-communi
 converted to MLX format from [Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)
 using mlx-lm version **0.24.1**.
 ## Use with mlx
 ```bash

 converted to MLX format from [Qwen/Qwen3-14B](https://huggingface.co/Qwen/Qwen3-14B)
 using mlx-lm version **0.24.1**.
+AWQ Parameters: --bits 4 --num-samples 256 --group-size 64 --sequence-length 1024, with a custom calibration dataset
 ## Use with mlx
 ```bash