Commit bb56aa5
fix(models): capture Anthropic thinking-block signatures during streaming
When streaming a Claude response with extended thinking enabled,
`AnthropicLlm.generate_content_async` consumed `thinking_delta` and `text_delta`
content-block deltas but ignored `signature_delta`. The aggregated thinking
`Part` was therefore assembled without its `thought_signature`.
On a follow-up request within the same turn (for example, after a tool call),
that signature-less thinking block cannot be serialized back into a valid
Anthropic `thinking` block, breaking multi-step (tool-calling) turns when
streaming is enabled. The non-streaming path is unaffected because it already
captures the signature via `content_block_to_part`.
Handle `SignatureDelta` in the streaming content-block-delta loop so the
signature is accumulated and attached to the aggregated thinking `Part`,
matching the non-streaming path. Extended-thinking + tool-use turns now
round-trip correctly under streaming.
Adds a regression test asserting that a streamed `signature_delta` lands on the
final thinking part and round-trips to a valid Anthropic thinking block.
Co-authored-by: Vishwa Murugan <vishwamurugan@google.com>
PiperOrigin-RevId: 9522566151 parent d4f157d commit bb56aa5
2 files changed
Lines changed: 91 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
829 | 829 | | |
830 | 830 | | |
831 | 831 | | |
| 832 | + | |
| 833 | + | |
| 834 | + | |
| 835 | + | |
| 836 | + | |
| 837 | + | |
| 838 | + | |
| 839 | + | |
| 840 | + | |
| 841 | + | |
| 842 | + | |
| 843 | + | |
| 844 | + | |
| 845 | + | |
832 | 846 | | |
833 | 847 | | |
834 | 848 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1919 | 1919 | | |
1920 | 1920 | | |
1921 | 1921 | | |
| 1922 | + | |
| 1923 | + | |
| 1924 | + | |
| 1925 | + | |
| 1926 | + | |
| 1927 | + | |
| 1928 | + | |
| 1929 | + | |
| 1930 | + | |
| 1931 | + | |
| 1932 | + | |
| 1933 | + | |
| 1934 | + | |
| 1935 | + | |
| 1936 | + | |
| 1937 | + | |
| 1938 | + | |
| 1939 | + | |
| 1940 | + | |
| 1941 | + | |
| 1942 | + | |
| 1943 | + | |
| 1944 | + | |
| 1945 | + | |
| 1946 | + | |
| 1947 | + | |
| 1948 | + | |
| 1949 | + | |
| 1950 | + | |
| 1951 | + | |
| 1952 | + | |
| 1953 | + | |
| 1954 | + | |
| 1955 | + | |
| 1956 | + | |
| 1957 | + | |
| 1958 | + | |
| 1959 | + | |
| 1960 | + | |
| 1961 | + | |
| 1962 | + | |
| 1963 | + | |
| 1964 | + | |
| 1965 | + | |
| 1966 | + | |
| 1967 | + | |
| 1968 | + | |
| 1969 | + | |
| 1970 | + | |
| 1971 | + | |
| 1972 | + | |
| 1973 | + | |
| 1974 | + | |
| 1975 | + | |
| 1976 | + | |
| 1977 | + | |
| 1978 | + | |
| 1979 | + | |
| 1980 | + | |
| 1981 | + | |
| 1982 | + | |
| 1983 | + | |
| 1984 | + | |
| 1985 | + | |
| 1986 | + | |
| 1987 | + | |
| 1988 | + | |
| 1989 | + | |
| 1990 | + | |
| 1991 | + | |
| 1992 | + | |
| 1993 | + | |
| 1994 | + | |
| 1995 | + | |
| 1996 | + | |
| 1997 | + | |
| 1998 | + | |
1922 | 1999 | | |
1923 | 2000 | | |
1924 | 2001 | | |
| |||
0 commit comments