Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ISTA-DASLab
/
Llama-3.2-1B-Instruct-GGUF
like
0
Follow
IST Austria Distributed Algorithms and Systems Lab
117
GGUF
llama
quantized
gptq
evopress
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Llama-3.2-1B-Instruct-GGUF
8.66 GB
1 contributor
History:
10 commits
helcig
Upload /Llama-3.2-1B-Instruct-GPTQ-Q6_K.gguf with huggingface_hub
6325019
verified
3 months ago
.gitattributes
Safe
2.13 kB
Upload /Llama-3.2-1B-Instruct-GPTQ-Q6_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-EvoPress-Q3_K.gguf
Safe
955 MB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-EvoPress-Q3_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-EvoPress-Q4_K.gguf
Safe
1.08 GB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-EvoPress-Q4_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-EvoPress-Q5_K.gguf
Safe
1.2 GB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-EvoPress-Q5_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-Q2_K.gguf
Safe
853 MB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-Q2_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-Q3_K.gguf
Safe
952 MB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-Q3_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-Q4_K.gguf
Safe
1.08 GB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-Q4_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-Q5_K.gguf
Safe
1.2 GB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-Q5_K.gguf with huggingface_hub
3 months ago
Llama-3.2-1B-Instruct-GPTQ-Q6_K.gguf
Safe
1.33 GB
xet
Upload /Llama-3.2-1B-Instruct-GPTQ-Q6_K.gguf with huggingface_hub
3 months ago
README.md
Safe
1.18 kB
Create README.md
3 months ago