RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • 3B • Updated Oct 23, 2024 • 2.99k • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Sep 22 • 10.9k • 18
joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF Text Generation • 8B • Updated Jul 24, 2024 • 1.52k • 1
azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16 Text Generation • 2B • Updated Aug 28, 2024 • 10 • 13
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 2B • Updated Sep 22 • 30.4k • 30