File size: 451 Bytes
96630e5 de021ef 96630e5 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
library_name: ctranslate2
base_model:
- LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct
base_model_relation: quantized
tags:
- ctranslate2
- chat
---
Ctranslate2 8-bit quantization of [
EXAONE-3.5-2.4B-Instruct](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct).
However, this would not have been possible without the model first being converted to Llama format [from here](https://huggingface.co/datalama/EXAONE-3.5-2.4B-Instruct-Llamafied)
|