Skip to content

feat: add Cohere API support to rankings converter - #443

Open
jzakrzew wants to merge 1 commit into
triton-inference-server:mainfrom
jzakrzew:cohere-rerank-converter
Open

feat: add Cohere API support to rankings converter#443
jzakrzew wants to merge 1 commit into
triton-inference-server:mainfrom
jzakrzew:cohere-rerank-converter

Conversation

@jzakrzew

@jzakrzew jzakrzew commented Oct 3, 2025

Copy link
Copy Markdown

Extend the RankingsConverter to support Cohere's reranking API format, which uses flat "documents" array instead of nested passage objects. This allows running reranking benchmarks with VLLM and other frameworks that support this.

This is enabled by setting rankings="cohere" in the configuration, similar to the existing TEI support (rankings="tei").

Extend the RankingsConverter to support Cohere's reranking API format,
which uses flat "documents" arrays instead of nested passage objects.

This is enabled by setting rankings="cohere" in the configuration,
similar to the existing TEI support (rankings="tei").
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants