RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 Text Generation • 24B • Updated Oct 29 • 4.55k • 1
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int4-gs128-asym Text Generation • 4B • Updated Mar 21 • 5
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int4-gs128-sym Text Generation • 4B • Updated Mar 21 • 3
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-asym Text Generation • 4B • Updated Mar 21 • 6
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-sym Text Generation • 4B • Updated Mar 21 • 5
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-asym Text Generation • 4B • Updated Mar 21 • 3
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-sym Text Generation • 4B • Updated Mar 21 • 3
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-asym Text Generation • 7B • Updated Mar 27 • 6
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-sym Text Generation • 7B • Updated Mar 27 • 6
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-asym Text Generation • 7B • Updated Mar 27 • 5
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-sym Text Generation • 7B • Updated Mar 27 • 7