PowerInfer
/

SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation

Model card Files Files and versions

SmallThinker-4BA0.6B-Instruct-GGUF

41.2 GB

2 contributors

History: 17 commits

Yixin Song

Update README.md

b6ca58d verified 4 months ago

.gitattributes

2.61 kB

Upload folder using huggingface_hub 5 months ago
README.md

6.16 kB

Update README.md 4 months ago
SmallThinker-4B-A0.6B-Instruct.F16.gguf

8.55 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.F16.gguf with huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.IQ4_NL.gguf

2.49 GB
xet

Upload folder using huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.IQ4_XS.gguf

2.37 GB
xet

Upload folder using huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q3_K.gguf

2.12 GB
xet

Upload folder using huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q3_K_S.gguf

1.94 GB
xet

Upload folder using huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q4_0.gguf

2.47 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.Q4_0.gguf with huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q4_0.powerinfer.gguf

2.29 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.Q4_0.powerinfer.gguf with huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q4_1.gguf

2.72 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.Q4_1.gguf with huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q4_K.gguf

2.63 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.Q4_K.gguf with huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q4_K_S.gguf

2.49 GB
xet

Upload folder using huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q5_K.gguf

3.06 GB
xet

Upload folder using huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q6_K.gguf

3.51 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.Q6_K.gguf with huggingface_hub 5 months ago
SmallThinker-4B-A0.6B-Instruct.Q8_0.gguf

4.55 GB
xet

Upload SmallThinker-4B-A0.6B-Instruct.Q8_0.gguf with huggingface_hub 5 months ago