Update 2025-07-31-cachegen.md

Author: kobe0938

_posts/2025-07-31-cachegen.md

@@ -3,11 +3,11 @@ layout: post
 title: "CacheGen: Store Your KV Cache on Disk or S3—Load Blazingly Fast!"
 thumbnail-img: /assets/img/cachegen.png
 share-img: /assets/img/cachegen.png
-author: Kuntai Du
+author: Kuntai Du, Kobe
 image: /assets/img/cachegen.png
 ---
 
-**TL;DR:** 🚀 CacheGen lets you store KV caches on disk or AWS S3 and load them *way* faster than recomputing! It compresses your KV cache up to **3× smaller than quantization** so that you can load your KV cache blazingly fast while keeping response quality high. Stop wasting compute --- use CacheGen to fully utilize your storage and get instant first-token speedup!
+**TL;DR:** 🚀 [CacheGen](https://arxiv.org/abs/2310.07240) lets you store KV caches on disk or AWS S3 and load them *way* faster than recomputing! It compresses your KV cache up to **3× smaller than quantization** so that you can load your KV cache blazingly fast while keeping response quality high. Stop wasting compute --- use CacheGen to fully utilize your storage and get instant first-token speedup!
 
 <div align="center">
 <img src="/assets/img/cachegen.png" alt="comparison" style="width: 97%; vertical-align:middle;">
@@ -69,6 +69,24 @@ remote_url: "lm://localhost:65434"
 remote_serde: "cachegen"
 ```
 
+## Citation
+
+If you use CacheGen in your research, please cite our paper:
+
+```bibtex
+@misc{liu2024cachegenkvcachecompression,
+      title={CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving}, 
+      author={Yuhan Liu and Hanchen Li and Yihua Cheng and Siddhant Ray and Yuyang Huang and Qizheng Zhang and Kuntai Du and Jiayi Yao and Shan Lu and Ganesh Ananthanarayanan and Michael Maire and Henry Hoffmann and Ari Holtzman and Junchen Jiang},
+      year={2024},
+      eprint={2310.07240},
+      archivePrefix={arXiv},
+      primaryClass={cs.NI},
+      url={https://arxiv.org/abs/2310.07240}, 
+}
+```
+
+**Paper:** [CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving](https://arxiv.org/abs/2310.07240)
+
 ## Contact
 
 - **LMCache Github: [https://github.com/LMCache/LMCache](https://github.com/LMCache/LMCache)**
@@ -77,4 +95,4 @@ remote_serde: "cachegen"
 - **vLLM Production-Stack [channel](https://vllm-dev.slack.com/archives/C089SMEAKRA)**
 
 
-**CacheGen: persistent, streaming context for fast, scalable LLMs—the LMCache Lab way!** 🚀
+**CacheGen: persistent, streaming context for fast, scalable LLMs—the LMCache Lab way!** 🚀