Fimeg/letta-server
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

feat: include tools as part of token estimate in compact (#9242)

Browse Source 
* base

* fix
This commit is contained in:
jnjpng
2026-02-02 15:58:49 -08:00
committed by Caren Thomas
parent 0bbb9c9bc0
commit 24ea7dbaed
3 changed files with 61 additions and 7 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
tests/integration_test_summarizer.py
View File

@@ -1046,10 +1046,10 @@ async def test_v3_summarize_hard_eviction_when_still_over_threshold(
# summarize_conversation_history to run and then hit the branch where the
# *post*-summarization token count is still above the proactive
# summarization threshold. We simulate that by patching the
# letta_agent_v3-level count_tokens helper to report an extremely large
# letta_agent_v3-level count_tokens_with_tools helper to report an extremely large
# token count for the first call (post-summary) and a small count for the
# second call (after hard eviction).
with patch("letta.agents.letta_agent_v3.count_tokens") as mock_count_tokens:
with patch("letta.agents.letta_agent_v3.count_tokens_with_tools") as mock_count_tokens:
# First call: pretend the summarized context is still huge relative to
# this model's context window so that we always trigger the
# hard-eviction path. Second call: minimal context (system only) is