35.8 GB

1 contributor

History: 14 commits

csabakecskemeti

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q5_K_S.gguf with huggingface_hub

cefb62e verified 5 months ago

.gitattributes

2.49 kB

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q5_K_S.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q2_K.gguf

1.66 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q2_K.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q3_K_L.gguf

2.27 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q3_K_L.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q3_K_M.gguf

2.12 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q3_K_M.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q3_K_S.gguf

1.94 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q3_K_S.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q4_K_M.gguf

2.63 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q4_K_M.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q4_K_S.gguf

2.49 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q4_K_S.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q5_K_M.gguf

3.06 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q5_K_M.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q5_K_S.gguf

2.98 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q5_K_S.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q6_K.gguf

3.51 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q6_K.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.Q8_0.gguf

4.55 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.Q8_0.gguf with huggingface_hub 5 months ago
PowerInfer.SmallThinker-4BA0.6B-Instruct.f16.gguf

8.55 GB
xet

Upload PowerInfer.SmallThinker-4BA0.6B-Instruct.f16.gguf with huggingface_hub 5 months ago
README.md

877 Bytes

Upload README.md with huggingface_hub 5 months ago