amysguan 47b0c87ebe Add modes self and self_sliding_window for prompt caching (#9372) ...

* add self compaction method with proper caching (pass in tools, don't refresh sys prompt beforehand) + sliding fallback

* updated prompts for self compaction

* add tests for self, self_sliding_window modes and w/o refresh messages before compaction

* add cache logging to summarization

* better handling to prevent agent from continuing convo on self modes

* if mode changes via summarize endpoint, will use default prompt for the new mode

---------

Co-authored-by: Amy Guan <amy@letta.com>

2026-02-24 10:55:26 -08:00

..

context_window_calculator

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

file_processor

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

helpers

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

lettuce

fix: revert lettuce client conditional import (#6163)

2025-11-13 15:36:56 -08:00

mcp

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

memory_repo

chore: cleanup (#9602)

2026-02-24 10:55:26 -08:00

provider_trace_backends

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

summarizer

Add modes self and self_sliding_window for prompt caching (#9372)

2026-02-24 10:55:26 -08:00

tool_executor

fix(memory): standardize tool parameter names (#9552)

2026-02-24 10:55:24 -08:00

tool_sandbox

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

__init__.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

agent_generate_completion_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

agent_manager.py

Default to lightweight compaction model instead of agent's model (#9488)

2026-02-24 10:55:12 -08:00

agent_serialization_manager.py

fix(core): handle None message_ids in context window calculator (#9330)

2026-02-24 10:55:11 -08:00

archive_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

block_manager_git.py

chore: cleanup (#9602)

2026-02-24 10:55:26 -08:00

block_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

clickhouse_otel_traces.py

feat: add provider trace backend abstraction for multi-backend telemetry (#8814)

2026-01-19 15:54:43 -08:00

clickhouse_provider_traces.py

feat(telem): support reading from clickhouse traces (#9431)

2026-02-24 10:52:07 -08:00

conversation_manager.py

feat: add order_by and order params to /v1/conversations list endpoin… (#9599)

2026-02-24 10:55:26 -08:00

credit_verification_service.py

fix: logging for credit verification step (#9514)

2026-02-24 10:55:11 -08:00

file_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

files_agents_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

group_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

identity_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

job_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

llm_batch_manager.py

fix(sec): first pass of ensuring actor id is required everywhere (#9126)

2026-01-29 12:44:04 -08:00

llm_trace_reader.py

feat: log LLM traces to clickhouse (#9111)

2026-02-24 10:52:06 -08:00

llm_trace_writer.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

mcp_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

mcp_server_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

message_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

organization_manager.py

rely on user_manager and organization_manager for error throwing [LET-4637] (#5420)

2025-10-24 15:12:11 -07:00

passage_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

provider_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

run_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

sandbox_config_manager.py

fix(sec): first pass of ensuring actor id is required everywhere (#9126)

2026-01-29 12:44:04 -08:00

sandbox_credentials_service_test.py

feat: have core ask cloud for any relavent api credentials to allow a… [LET-6179] (#6172)

2025-11-24 19:09:32 -08:00

sandbox_credentials_service.py

feat: have core ask cloud for any relavent api credentials to allow a… [LET-6179] (#6172)

2025-11-24 19:09:32 -08:00

source_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

step_manager.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

streaming_service.py

feat(core): add model/model_settings override fields to conversation create/update (#9607)

2026-02-24 10:55:26 -08:00

telemetry_manager.py

feat(telem): support reading from clickhouse traces (#9431)

2026-02-24 10:52:07 -08:00

tool_manager.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

tool_schema_generator.py

chore: add more tracing to tool upsert endpoint (#6471)

2025-12-15 12:02:19 -08:00

user_manager.py

fix: no default actor setting check (#9124)

2026-01-29 12:44:04 -08:00

webhook_service_test.py

feat: support webhooks for step completions (#5904)

2025-11-13 15:36:50 -08:00

webhook_service.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00