which tool-call-parser should be used when serving by vllm?

#33
by xiaoheixiaohei - opened

{"error":{"message":""auto" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}

I only see deepseekv31_tool_parser.py and deepseekv3_tool_parser.py in vllm repo, can we use deepseekv31_tool_parser for DeepSeek-V3.2-Exp? Thanks!

Sign up or log in to comment