| library_name: ctranslate2 | |
| base_model: | |
| - LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct | |
| base_model_relation: quantized | |
| tags: | |
| - ctranslate2 | |
| - chat | |
| Ctranslate2 8-bit quantization of [ | |
| EXAONE-3.5-2.4B-Instruct](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct). | |
| However, this would not have been possible without the model first being converted to Llama format [from here](https://huggingface.co/datalama/EXAONE-3.5-2.4B-Instruct-Llamafied) | |