amd
/

DeepSeek-R1-MXFP4-Preview

8-bit precision

Model card Files Files and versions

linzhao-amd commited on Aug 1

Commit

b35e9d0

·

verified ·

1 Parent(s): 3828dcc

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -13,7 +13,7 @@ base_model:
 - **Supported Hardware Microarchitecture:** AMD MI350/MI355
 - **ROCm**: 7.0-Preview
 - **Preferred Operating System(s):** Linux
-- **Inference Engine:** [vLLM](https://docs.vllm.ai/en/latest/)
 - **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html)
   - **Weight quantization:** OCP MXFP4
   - **Activation quantization:** OCP MXFP4

 - **Supported Hardware Microarchitecture:** AMD MI350/MI355
 - **ROCm**: 7.0-Preview
 - **Preferred Operating System(s):** Linux
+- **Inference Engine:** [SGLang](https://docs.sglang.ai/)
 - **Model Optimizer:** [AMD-Quark](https://quark.docs.amd.com/latest/index.html)
   - **Weight quantization:** OCP MXFP4
   - **Activation quantization:** OCP MXFP4