Hugging Face's logo

Spaces:
stepfun-ai
/
Step-Audio-R1
Running

App Files Community
1
moevis commited on
Commit
4d8dd77
·
verified ·
1 Parent(s): 5276d34

Update start_services.sh

Browse files
Files changed (1) hide show
  1. start_services.sh +1 -1
start_services.sh CHANGED
@@ -43,7 +43,7 @@ python3 -m vllm.entrypoints.openai.api_server \
43
  --host 0.0.0.0 \
44
  --max-model-len 8192 \
45
  --tensor-parallel-size 4 \
46
- --gpu-memory-utilization 0.85 \
47
  --trust-remote-code \
48
  --interleave-mm-strings \
49
  --served-model-name Step-Audio-R1 \
 
43
  --host 0.0.0.0 \
44
  --max-model-len 8192 \
45
  --tensor-parallel-size 4 \
46
+ --gpu-memory-utilization 0.95 \
47
  --trust-remote-code \
48
  --interleave-mm-strings \
49
  --served-model-name Step-Audio-R1 \