What value should be selected for parameter `--tool-call-parser` when deploying VLLM?

[yaozhicheng]

What value should be selected for parameter --tool-call-parser when deploying VLLM?

[seasoncool]

Which version of vLLM is currently supported for deploying this model?

[wonderisland]

What value should be selected for parameter --tool-call-parser when deploying VLLM?

same question, can anyone solve it?

[KelvinF97]

Which version of vLLM is currently supported for deploying this model?

Please give us the correct version vllm which can support this model.

[yaozhicheng]

Which version of vLLM is currently supported for deploying this model?

Please give us the correct version vllm which can support this model.

Manually adding this PR （https://github.com/vllm-project/vllm/pull/31575/files） to the latest vllm will enable it, but the tool cannot be invoked

[linygood]

same question， --tool-call-parser=？

[leonselina]

waiting...

[growricherwang]

try hermes

[lcorallo]

I've tested hermes tool call parser, but still not working