You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A new datalayer Collector plugin (kv-cache-collector) that periodically scrapes Prometheus metrics from each inference pool and exposes KV-cache utilization and queue depth as per-model attributes in the IPP datastore.
A new datalayer
Collectorplugin (kv-cache-collector) that periodically scrapes Prometheus metrics from each inference pool and exposes KV-cache utilization and queue depth as per-model attributes in the IPP datastore.