Commit
·
6c124fa
1
Parent(s):
6ec21e7
Update Step-3.5-Flash vLLM recipe (#1)
Browse files- Update Step-3.5-Flash vLLM recipe (5141b7537b1d89d9b4d5642f04affc29d9a276ef)
Co-authored-by: jeejeelee <jeeejeee@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -208,6 +208,7 @@ vllm serve <MODEL_PATH_OR_HF_ID> \
|
|
| 208 |
--speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
|
| 209 |
--trust-remote-code
|
| 210 |
```
|
|
|
|
| 211 |
|
| 212 |
### 6.2 SGLang
|
| 213 |
|
|
|
|
| 208 |
--speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
|
| 209 |
--trust-remote-code
|
| 210 |
```
|
| 211 |
+
You can also refer to the [Step-3.5-Flash](https://github.com/vllm-project/recipes/blob/main/StepFun/Step-3.5-Flash.md) recipe.
|
| 212 |
|
| 213 |
### 6.2 SGLang
|
| 214 |
|