feat: Support logprobs for vLLM models in OpenAI Frontend#8538

pskiran1 merged 23 commits into

maintriton-inference-server/server:mainfrom

spolisetty/tri-216-add-support-for-logprobs-and-top_logprobs-in-triton-openaitriton-inference-server/server:spolisetty/tri-216-add-support-for-logprobs-and-top_logprobs-in-triton-openaiCopy head branch name to clipboard