Hugging Face's logo

bartowski
/
PowerInfer_SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation
GGUF
conversational
Model card Files
xet
Community
PowerInfer_SmallThinker-4BA0.6B-Instruct-GGUF

Commit History

Update metadata with huggingface_hub
4c10a5f
verified

bartowski commited on

Upload README.md with huggingface_hub
bcfdd2f
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-imatrix.gguf with huggingface_hub
5939823
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-bf16.gguf with huggingface_hub
5447665
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-IQ2_M.gguf with huggingface_hub
a0857d4
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q2_K.gguf with huggingface_hub
fc60341
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q2_K_L.gguf with huggingface_hub
b89d405
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-IQ3_XXS.gguf with huggingface_hub
f250870
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-IQ3_XS.gguf with huggingface_hub
96efa34
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_S.gguf with huggingface_hub
6188332
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-IQ3_M.gguf with huggingface_hub
6b98cbf
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_M.gguf with huggingface_hub
d21c34c
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_L.gguf with huggingface_hub
1a6541e
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q3_K_XL.gguf with huggingface_hub
7aa7fca
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-IQ4_XS.gguf with huggingface_hub
0e83067
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-IQ4_NL.gguf with huggingface_hub
a819728
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_0.gguf with huggingface_hub
6097687
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_1.gguf with huggingface_hub
7115be6
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_K_S.gguf with huggingface_hub
386e5c5
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_K_M.gguf with huggingface_hub
a462eb7
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q4_K_L.gguf with huggingface_hub
d6c8ae4
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q5_K_S.gguf with huggingface_hub
cfecb7e
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q5_K_M.gguf with huggingface_hub
08ca809
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q5_K_L.gguf with huggingface_hub
8743f47
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q6_K.gguf with huggingface_hub
652baab
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q6_K_L.gguf with huggingface_hub
b1f064d
verified

bartowski commited on

Upload PowerInfer_SmallThinker-4BA0.6B-Instruct-Q8_0.gguf with huggingface_hub
6a8cd38
verified

bartowski commited on

initial commit
8e0e611
verified

bartowski commited on