diff --git a/helm/README.md b/helm/README.md index c5ab301a0..0053f7f4a 100644 --- a/helm/README.md +++ b/helm/README.md @@ -459,6 +459,10 @@ kubectl port-forward svc/-grafana 8080:80 Open the webpage at `http://:8080` to access the Grafana web page. The default user name is `admin` and the password can be configured in the values (default is generated by helm and stored in a secret `-grafana`). +### LMCache Dashboard + +If you use the LMCache image in the production stack, the chart includes a dedicated LMCache dashboard (provisioned automatically alongside the main vLLM dashboard when `grafanaDashboards.enabled` is set to `true`). It contains six fields showing the benefits of CPU offloading: Average time to first token (sec), Cache hit rate (%) in last 1 minute, LMCache retrieve speed (K Tokens / sec), Local CPU cache usage (GB), Number of requested tokens in total, and Number of hit tokens in total. + ### Use Prometheus Adapter to export vLLM metrics The vLLM router can export metrics to Prometheus using the [Prometheus Adapter](https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-adapter).