Skip to content

Commit 6ab59be

Browse files
authored
Update 2025-09-18-dynamo-lmcache.md
1 parent ab07a87 commit 6ab59be

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

_posts/2025-09-18-dynamo-lmcache.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,9 @@ author: NVIDIA Dynamo team, LMCache team
77

88
We're thrilled to announce that [**Nvidia Dynamo**](https://github.com/ai-dynamo/dynamo) **has integrated [LMCache](https://github.com/LMCache/LMCache) as a [KV caching layer solution](https://docs.nvidia.com/dynamo/latest/components/backends/vllm/LMCache_Integration.html)**. This is a big milestone: Dynamo gets a battle-tested caching solution, and LMCache becomes part of a data center-scale inference platform used by many developers worldwide to deploy AI at scale.
99

10+
<img width="1239" height="228" alt="image" src="https://github.com/user-attachments/assets/303891b9-f5ac-4757-b300-29955a52639a" />
11+
12+
1013
For comprehensive details about Dynamo's KV cache optimization capabilities, see the **[NVIDIA Developer Blog post on reducing KV cache bottlenecks](https://developer.nvidia.com/blog/how-to-reduce-kv-cache-bottlenecks-with-nvidia-dynamo/)**.
1114

1215
## **Why KV Caching Matters**
@@ -54,4 +57,4 @@ Together, with the Dynamo team, we’re laying the foundation for a **more effic
5457

5558
**Acknowledgements**
5659

57-
Special thanks to Vikram Mailthody, Harry Kim, Ashutosh Malegaonkar, Suman Taitraju, Richard Huo, Omri Kahalon, Vishwanath Venkatesan, Adit Ranadive, Pen Chung Li, John Kim, and David Edelsohn, in close collaboration with LMCache contributors from TensorMesh.
60+
Special thanks to Vikram Mailthody, Harry Kim, Ashutosh Malegaonkar, Suman Taitraju, Richard Huo, Omri Kahalon, Vishwanath Venkatesan, Adit Ranadive, Pen Chung Li, John Kim, and David Edelsohn, in close collaboration with LMCache contributors from TensorMesh.

0 commit comments

Comments
 (0)