Commit f845eed
authored
[doc]Implement the function of a kv cache calculator html in User Guide (#652)
Implements a KV Cache Size Calculator to help users estimate memory
requirements for LLM inference across different model architectures.1 parent 8cc9b74 commit f845eed
3 files changed
Lines changed: 2449 additions & 0 deletions
0 commit comments