Text Generation
Transformers
Safetensors
step3p5
conversational
custom_code
Eval Results
WinstonDeng jeeejeee commited on
Commit
6c124fa
·
1 Parent(s): 6ec21e7

Update Step-3.5-Flash vLLM recipe (#1)

Browse files

- Update Step-3.5-Flash vLLM recipe (5141b7537b1d89d9b4d5642f04affc29d9a276ef)


Co-authored-by: jeejeelee <jeeejeee@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -208,6 +208,7 @@ vllm serve <MODEL_PATH_OR_HF_ID> \
208
  --speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
209
  --trust-remote-code
210
  ```
 
211
 
212
  ### 6.2 SGLang
213
 
 
208
  --speculative_config '{"method": "step3p5_mtp", "num_speculative_tokens": 1}' \
209
  --trust-remote-code
210
  ```
211
+ You can also refer to the [Step-3.5-Flash](https://github.com/vllm-project/recipes/blob/main/StepFun/Step-3.5-Flash.md) recipe.
212
 
213
  ### 6.2 SGLang
214