Skip to content

Commit ab07a87

Browse files
authored
Merge pull request #52 from kobe0938/main
add nvidia mentioned link
2 parents 7dfccb5 + 5566a30 commit ab07a87

1 file changed

Lines changed: 5 additions & 1 deletion

File tree

_posts/2025-09-18-dynamo-lmcache.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,9 @@ comments: true
55
author: NVIDIA Dynamo team, LMCache team
66
---
77

8-
We’re thrilled to announce that [**Nvidia Dynamo**](https://github.com/ai-dynamo/dynamo) **has integrated [LMCache](https://github.com/LMCache/LMCache) as a [KV caching layer solution](https://docs.nvidia.com/dynamo/latest/components/backends/vllm/LMCache_Integration.html)**. This is a big milestone: Dynamo gets a battle-tested caching solution, and LMCache becomes part of a data center-scale inference platform used by many developers worldwide to deploy AI at scale.
8+
We're thrilled to announce that [**Nvidia Dynamo**](https://github.com/ai-dynamo/dynamo) **has integrated [LMCache](https://github.com/LMCache/LMCache) as a [KV caching layer solution](https://docs.nvidia.com/dynamo/latest/components/backends/vllm/LMCache_Integration.html)**. This is a big milestone: Dynamo gets a battle-tested caching solution, and LMCache becomes part of a data center-scale inference platform used by many developers worldwide to deploy AI at scale.
9+
10+
For comprehensive details about Dynamo's KV cache optimization capabilities, see the **[NVIDIA Developer Blog post on reducing KV cache bottlenecks](https://developer.nvidia.com/blog/how-to-reduce-kv-cache-bottlenecks-with-nvidia-dynamo/)**.
911

1012
## **Why KV Caching Matters**
1113

@@ -42,6 +44,8 @@ This unlocks more advanced workflows:
4244

4345
For a deeper dive into the motivation, design scope, and integration details, see the official [Nvidia Dynamo documentation on LMCache integration](https://docs.nvidia.com/dynamo/latest/components/backends/vllm/LMCache_Integration.html?utm_source=chatgpt.com).
4446

47+
For more technical details about how Dynamo reduces KV cache bottlenecks and the broader context of this integration, check out the **[NVIDIA Developer Blog post on KV Cache optimization with Dynamo](https://developer.nvidia.com/blog/how-to-reduce-kv-cache-bottlenecks-with-nvidia-dynamo/)**.
48+
4549
## **Looking Ahead**
4650

4751
We’re excited to see how developers and enterprises adopt this integration in production. With KV caching becoming a standard practice across the industry, LMCache and Dynamo integration ensures that the ecosystem can move faster, serve more users, and deliver lower-latency AI applications.

0 commit comments

Comments
 (0)