inference-optimization/granite-4.0-h-tiny-FP8-block
Text Generation
•
7B
•
Updated
•
57
Granite 4 Small and Tiny Quantized Models
FP8-block, FP8-dynamic, NVFP4, w4a16, w8a8 quantized models of ibm-granite/granite-4.0-h-small and ibm-granite/granite-4.0-h-tiny models
-
-
inference-optimization/granite-4.0-h-tiny-FP8-dynamic
Text Generation • 7B • Updated • 57 -
inference-optimization/granite-4.0-h-tiny-quantized.w4a16
Updated • 37 -
inference-optimization/granite-4.0-h-tiny-NVFP4
Updated • 8 -
inference-optimization/granite-4.0-h-tiny-quantized.w8a8
7B • Updated • 46 -
inference-optimization/granite-4.0-h-small-FP8-block
Updated -
inference-optimization/granite-4.0-h-small-FP8-dynamic
Updated -
inference-optimization/granite-4.0-h-small-quantized.w4a16
Updated -
inference-optimization/granite-4.0-h-small-NVFP4
Updated -
inference-optimization/granite-4.0-h-small-quantized.w8a8
Updated