amysguan 47b0c87ebe Add modes self and self_sliding_window for prompt caching (#9372) ...

* add self compaction method with proper caching (pass in tools, don't refresh sys prompt beforehand) + sliding fallback

* updated prompts for self compaction

* add tests for self, self_sliding_window modes and w/o refresh messages before compaction

* add cache logging to summarization

* better handling to prevent agent from continuing convo on self modes

* if mode changes via summarize endpoint, will use default prompt for the new mode

---------

Co-authored-by: Amy Guan <amy@letta.com>

2026-02-24 10:55:26 -08:00

89 KiB

Raw Blame History

View Raw