Available Model files:
EXAONE-4.0-1.2B.Q8_0.ggufEXAONE-4.0-1.2B.Q4_K_M.gguf
use System instructions
๐ข Please check out the guide from LG AI Research
Note
- LGAI-EXAONE/EXAONE-4.0-32B model works with system prompt instructions.
- The model's BOS token behavior was adjusted for GGUF compatibility.
- This model was finetuned and converted to GGUF format using Unsloth.
- Downloads last month
- 235
Hardware compatibility
Log In
to view the estimation
4-bit
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for ss-lab/EXAONE-4.0-1.2B-GGUF
Base model
LGAI-EXAONE/EXAONE-4.0-1.2B