Skip to content

docs(helm): restore LMCache dashboard explanation in Observability section #982

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ruizhang0101 merged 2 commits into from
Jun 25, 2026
+4 −0
Merged

docs(helm): restore LMCache dashboard explanation in Observability section #982

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
a4b997c
docs(helm): restore LMCache dashboard explanation in Observability se…
samhoss93 Jun 24, 2026
29f8638
Merge branch 'main' into docs/lmcache-dashboard-explanation
ruizhang0101 Jun 25, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions helm/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -459,6 +459,10 @@ kubectl port-forward svc/<release-name>-grafana 8080:80

Open the webpage at `http://<IP of your node>:8080` to access the Grafana web page. The default user name is `admin` and the password can be configured in the values (default is generated by helm and stored in a secret `<release-name>-grafana`).

### LMCache Dashboard

If you use the LMCache image in the production stack, the chart includes a dedicated LMCache dashboard (provisioned automatically alongside the main vLLM dashboard when `grafanaDashboards.enabled` is set to `true`). It contains six fields showing the benefits of CPU offloading: Average time to first token (sec), Cache hit rate (%) in last 1 minute, LMCache retrieve speed (K Tokens / sec), Local CPU cache usage (GB), Number of requested tokens in total, and Number of hit tokens in total.

### Use Prometheus Adapter to export vLLM metrics

The vLLM router can export metrics to Prometheus using the [Prometheus Adapter](https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-adapter).
Expand Down
Loading