Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

RedHatAI
/
Meta-Llama-3-70B-Instruct-quantized.w4a16

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions
xet
Community
2
Meta-Llama-3-70B-Instruct-quantized.w4a16
39.8 GB
  • 3 contributors
History: 4 commits
abhinavnmagic's picture
abhinavnmagic
Upload quantize_config.json with huggingface_hub
8033a3c verified over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • config.json
    1.05 kB
    Upload config.json with huggingface_hub over 1 year ago
  • model.safetensors
    39.8 GB
    xet
    Upload model.safetensors with huggingface_hub over 1 year ago
  • quantize_config.json
    269 Bytes
    Upload quantize_config.json with huggingface_hub over 1 year ago