Astrotalk 1531829cc3 - Add cache control to system messages ...

- Cache static system content to reduce token costs on repeated requests
                              - Maintain existing conversation flow while optimizing API costs
                              - Support both string and list format system messages

                              This change leverages Anthropic's ephemeral caching to reduce costs for
                              frequently used system prompts and personas without affecting functionality.

2025-06-17 18:25:07 +05:30

..

agents

feat: send stop reason in letta APIs (#2789)

2025-06-13 16:04:48 -07:00

cli

chore: bump version 0.7.22 (#2655)

2025-05-23 01:13:05 -07:00

client

fix: tool rules bug in new agent loop (#2724)

2025-06-09 23:05:25 -07:00

data_sources

feat: redis user caching (#2774)

2025-06-12 17:32:07 -07:00

functions

Merge branch 'main' into 0.8.4-release-2

2025-06-15 11:19:51 -07:00

groups

feat: consolidate logic for finish tokens (#2779)

2025-06-12 15:24:06 -07:00

helpers

feat: redis user caching (#2774)

2025-06-12 17:32:07 -07:00

humans

chore: migrate package name to letta (#1775)

2024-09-23 09:15:18 -07:00

interfaces

fix: avoid calling model_dump on stop reason messages twice (#2811)

2025-06-13 18:25:35 -07:00

jobs

fix formatting

2025-06-02 21:17:03 -07:00

llm_api

- Add cache control to system messages

2025-06-17 18:25:07 +05:30

local_llm

feat: add token column to mcp_servers and pipe through to sse server config (#2775)

2025-06-14 18:48:10 -07:00

openai_backcompat

feat: Composio tools execute on-the-fly (#999)

2025-02-13 16:13:29 -08:00

orm

Merge branch 'main' into 0.8.4-release-2

2025-06-15 11:19:51 -07:00

otel

fix: metrics imports (#2801)

2025-06-13 14:39:24 -07:00

personas

feat: Adjust prompts and integrate voice sleeptime group into agent manager (#1927)

2025-04-29 13:43:59 -07:00

plugins

feat: plugin system and backend runtime flags (#2543)

2025-06-05 18:12:44 -07:00

prompts

feat: display file blocks with xml tags (#2559)

2025-06-03 13:52:29 -07:00

schemas

Merge branch 'main' into 0.8.4-release-2

2025-06-15 11:19:51 -07:00

serialize_schemas

feat: async db client (#2076)

2025-05-12 17:15:14 -07:00

server

Merge branch 'main' into 0.8.4-release-2

2025-06-15 11:19:51 -07:00

services

Merge branch 'main' into 0.8.4-release-2

2025-06-15 11:19:51 -07:00

templates

fix: numerous tool execution bugs (#2371)

2025-05-23 18:02:15 -07:00

types

fix: numerous tool execution bugs (#2371)

2025-05-23 18:02:15 -07:00

__init__.py

Merge branch 'main' into 0.8.4-release-2

2025-06-15 11:19:51 -07:00

agent.py

feat: add multi-modal input support (#2590)

2025-06-08 18:28:01 -07:00

config.py

run black, add isort config to pyproject.toml

2024-12-26 19:43:11 -08:00

constants.py

feat: tune file tools prompting (#2652)

2025-06-13 16:24:59 -07:00

embeddings.py

chore: Various bug fixes (#1350)

2025-03-20 11:06:45 -07:00

errors.py

fix: Make OpenAI context window exceeded error more specific (#2624)

2025-06-04 12:57:51 -07:00

interface.py

feat: add otid field for message idempotency (#1556)

2025-04-04 08:43:01 -07:00

log.py

feat: Patch broken assistant messages for both Haiku and Sonnet (#1252)

2025-03-12 10:19:41 -07:00

main.py

chore: bump version 0.7.22 (#2655)

2025-05-23 01:13:05 -07:00

memory.py

feat: otel metrics and expanded collecting (#2647)

2025-06-05 17:20:14 -07:00

pytest.ini

chore: migrate package name to letta (#1775)

2024-09-23 09:15:18 -07:00

settings.py

fix: metric tracking (#2785)

2025-06-13 13:53:10 -07:00

streaming_interface.py

test: add additional new agent messaging tests (#2120)

2025-05-12 15:58:52 -07:00

streaming_utils.py

feat: add anthropic streaming (#716)

2025-01-26 17:35:22 -08:00

system.py

fix: unpacking non json values (#2684)

2025-06-09 11:11:56 -07:00

utils.py

fix: list ollama embeddings models (#2711)

2025-06-10 10:44:26 -07:00