Fimeg/letta-server
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

fix(core): ensure buffered Anthropic tool chunks always include otid (#9516)

Browse Source 
fix(core): ensure otid exists when flushing buffered anthropic tool chunks

Anthropic TOOL_USE buffering can emit buffered tool_call/approval chunks on content block stop before otid is assigned in the normal inner_thoughts_complete path. Ensure flush-time chunks get a deterministic otid so streaming clients can reliably correlate deltas.

👾 Generated with [Letta Code](https://letta.com)

Co-authored-by: Letta <noreply@letta.com>
This commit is contained in:
jnjpng
2026-02-23 11:21:49 -08:00
committed by Caren Thomas
parent f082fd5061
commit a59f24ac87
1 changed files with 7 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
letta/interfaces/anthropic_streaming_interface.py
View File

@@ -593,9 +593,15 @@ class AnthropicStreamingInterface:
pass
elif isinstance(event, BetaRawContentBlockStopEvent):
# If we're exiting a tool use block and there are still buffered messages,
# we should flush them now
# we should flush them now.
# Ensure each flushed chunk has an otid before yielding.
if self.anthropic_mode == EventMode.TOOL_USE and self.tool_call_buffer:
for buffered_msg in self.tool_call_buffer:
if not buffered_msg.otid:
if prev_message_type and prev_message_type != buffered_msg.message_type:
message_index += 1
buffered_msg.otid = Message.generate_otid_from_id(buffered_msg.id, message_index)
prev_message_type = buffered_msg.message_type
yield buffered_msg
self.tool_call_buffer = []