Skip to content

Add usage.prompt_tokens_details.cached_tokens for prefix caching#4670

Merged
lvhan028 merged 5 commits into
InternLM:mainfrom
lvhan028:feat/cached-tokens-usage
Jun 18, 2026
Merged

Add usage.prompt_tokens_details.cached_tokens for prefix caching#4670
lvhan028 merged 5 commits into
InternLM:mainfrom
lvhan028:feat/cached-tokens-usage

Commits

Commits on Jun 16, 2026