Skip to content

Commit f845eed

Browse files
authored
[doc]Implement the function of a kv cache calculator html in User Guide (#652)
Implements a KV Cache Size Calculator to help users estimate memory requirements for LLM inference across different model architectures.
1 parent 8cc9b74 commit f845eed

3 files changed

Lines changed: 2449 additions & 0 deletions

File tree

0 commit comments

Comments
 (0)