Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Meta-Llama-3-70B-Instruct-quantized.w4a16
like
2
Follow
Red Hat AI
1.72k
Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
4-bit precision
gptq
License:
llama3
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
8033a3c
Meta-Llama-3-70B-Instruct-quantized.w4a16
39.8 GB
3 contributors
History:
4 commits
abhinavnmagic
Upload quantize_config.json with huggingface_hub
8033a3c
verified
over 1 year ago
.gitattributes
1.52 kB
initial commit
over 1 year ago
config.json
1.05 kB
Upload config.json with huggingface_hub
over 1 year ago
model.safetensors
39.8 GB
xet
Upload model.safetensors with huggingface_hub
over 1 year ago
quantize_config.json
269 Bytes
Upload quantize_config.json with huggingface_hub
over 1 year ago