Add composite metrics for kubernetes inference gateway metrics protocol - #725

Open

BenjaminBraunDev wants to merge 6 commits into

triton-inference-server:mainfrom

BenjaminBraunDev:main

Commits on Mar 11, 2025

Add custom kv cache and waiting requests metric.
BenjaminBraunDev
committed

Commits on Mar 13, 2025

Add first draft of new composite metrics.
BenjaminBraunDev
committed

Commits on Mar 20, 2025

Small change to kv custom metric.
BenjaminBraunDev
committed

Commits on Mar 21, 2025

Merge branch 'triton-inference-server:main' into main
BenjaminBraunDev
authored

Commits on Mar 25, 2025