which tool-call-parser should be used when serving by vllm?
#33
by
xiaoheixiaohei
- opened
{"error":{"message":""auto" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}
I only see deepseekv31_tool_parser.py and deepseekv3_tool_parser.py in vllm repo, can we use deepseekv31_tool_parser for DeepSeek-V3.2-Exp? Thanks!