When will the FP8 version be released?
https://huggingface.co/docs/transformers/quantization/finegrained_fp8
https://huggingface.co/huihui-ai/Huihui-Qwen3-VL-4B-Instruct-abliterated-FP8
Β· Sign up or log in to comment