Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

arxiv: 2402.08268

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

81

Full-text search

Active filters: 2402.08268

chienweichang/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • 8B • Updated May 7, 2024 • 40 • 1

vsevolodl/Llama-3-70B-Instruct-Gradient-1048k-GGUF

Text Generation • 71B • Updated May 10, 2024 • 127 • 3

vsevolodl/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • 8B • Updated May 10, 2024 • 136 • 1

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-262k-4bits

Text Generation • 5B • Updated May 10, 2024 • 6

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-262k-gguf

8B • Updated May 11, 2024 • 126 • 1

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-1048k-gguf

8B • Updated May 11, 2024 • 143

starsy/Llama-3-70B-Instruct-Gradient-262k-AWQ

Text Generation • 11B • Updated May 17, 2024 • 10

starsy/Llama-3-70B-Instruct-Gradient-1048k-AWQ

Text Generation • 11B • Updated May 17, 2024 • 3 • 1

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-4bits

Text Generation • 5B • Updated May 15, 2024 • 6

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-8bits

Text Generation • 8B • Updated May 15, 2024 • 6

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-gguf

8B • Updated May 15, 2024 • 244

RichardErkhov/gradientai_-_Llama-3-70B-Instruct-Gradient-1048k-gguf

71B • Updated May 29, 2024 • 292

SharryOG/llama3-8b-1048k

Text Generation • 8B • Updated Jul 29, 2024 • 5

QuantFactory/Llama-3-8B-ProLong-64k-Instruct-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 293 • 1

RichardErkhov/princeton-nlp_-_Llama-3-8B-ProLong-64k-Base-gguf

8B • Updated Aug 14, 2024 • 1.14k

RichardErkhov/gradientai_-_Llama-3-70B-Instruct-Gradient-524k-gguf

71B • Updated Oct 11, 2024 • 57

RichardErkhov/gradientai_-_Llama-3-70B-Instruct-Gradient-262k-gguf

71B • Updated Oct 15, 2024 • 129

mav23/Llama-3-8B-Instruct-Gradient-1048k-GGUF

Text Generation • 8B • Updated Nov 2, 2024 • 147

mav23/Llama-3-8B-Instruct-Gradient-4194k-GGUF

Text Generation • 8B • Updated Nov 11, 2024 • 118

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-1048k-8bits

8B • Updated Mar 30 • 7

RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-1048k-awq

2B • Updated Mar 30 • 3