This is the Deepseek-R1-Distill-Qwen-7B model, convert to OpenVINO with symmetric channel-wise INT4 weight compression.

Downloads last month
27
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including llmware/DeepSeek-R1-Distill-Qwen-7B-ov-int4-npu