Hugging Face's logo

inference-optimization
/
Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head

Safetensors
llama
compressed-tensors
Model card Files
xet
Community
Llama-3.1-8B-Instruct-FP8-dynamic-QKV-Cache-FP8-Per-Head
File size: 135 Bytes 
60413b2
 
 
 
1
2
3
4
 
version https://git-lfs.github.com/spec/v1
oid sha256:14ba08dbc51810849ac0a671856e8c835f1cae1bd8e6d46980dfa1e9323d219a
size 4997847248