Skip to content

Commit cfa2bbf

Browse files
davidgoliclaudetim-smart
authored
fix(ai-anthropic): populate cachedInputTokens in streaming responses (#6288)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Co-authored-by: Tim <hello@timsmart.co>
1 parent 95c7d2e commit cfa2bbf

2 files changed

Lines changed: 6 additions & 0 deletions

File tree

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
---
2+
"@effect/ai-anthropic": patch
3+
---
4+
5+
populate `cachedInputTokens` in streaming responses from `cache_read_input_tokens`

packages/ai/anthropic/src/AnthropicLanguageModel.ts

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -971,6 +971,7 @@ const makeStreamResponse: (
971971
case "message_start": {
972972
// Track usage metadata
973973
usage.inputTokens = event.message.usage.input_tokens
974+
usage.cachedInputTokens = event.message.usage.cache_read_input_tokens ?? undefined
974975
metaUsage = event.message.usage
975976

976977
// Track response metadata

0 commit comments

Comments
 (0)