Ani Tunturi 93337ce680 fix: pass images from tool returns to vision models ...

OpenAI Chat Completions requires tool message content to be a string,
so images in tool returns were silently replaced with [Image omitted].

Now: text stays in the tool return, images get injected as a user
message right after. The model actually sees what the tool saw.

to_openai_dict also cleaned up — image handling lives in
to_openai_dicts_from_list where it can inject the extra message.

2026-03-21 12:41:37 -04:00

..

openai

fix(core): add OpenAI 24h prompt cache retention for supported models (#9509)

2026-02-24 10:55:11 -08:00

providers

feat: add gpt-5.3-chat-latest model support (#9746)

2026-03-03 18:34:15 -08:00

agent_file.py

feat: add skills support to agentfile (#9287)

2026-02-24 10:52:06 -08:00

agent.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

archive.py

fix: don't need embedding model for self hosted [LET-7009] (#8935)

2026-01-29 12:44:04 -08:00

block.py

fix: add field validators to Block schema for int32 limit and null bytes (#9185)

2026-02-24 10:52:05 -08:00

conversation.py

feat(core): add model/model_settings override fields to conversation create/update (#9607)

2026-02-24 10:55:26 -08:00

embedding_config_overrides.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

embedding_config.py

fix: remove letta-free embeddings from testing (#6870)

2025-12-15 12:03:09 -08:00

enums.py

fix: add LLMCallType enum and ensure call_type is set on all provider traces (#9258)

2026-02-24 10:52:06 -08:00

environment_variables.py

chore: remove dead sync model validator code (#8606)

2026-01-19 15:54:37 -08:00

file.py

feat: move sources to folders [LET-6189] (#6199)

2025-11-24 19:09:32 -08:00

folder.py

docs: remove schemas from docstrings (#6059)

2025-11-13 15:36:56 -08:00

group.py

feat: add ID format validation to group schemas (#9152)

2026-01-29 12:44:04 -08:00

health.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

identity.py

feat: add ID format validation to identity schemas (#9153)

2026-01-29 12:44:04 -08:00

job.py

docs: remove schemas from docstrings (#6059)

2025-11-13 15:36:56 -08:00

letta_base.py

Revert "feat: add input data to pydantic validation error logging" (#5847)

2025-11-13 15:36:14 -08:00

letta_message_content.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

letta_message.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

letta_request.py

feat: new agent id query param for default convo (#9756)

2026-03-03 18:34:15 -08:00

letta_response.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

letta_stop_reason.py

feat: add credit verification before agent message endpoints [LET-XXXX] (#9433)

2026-02-24 10:52:07 -08:00

llm_batch_job.py

chore: add new primitive types and replace id_prefixes everywhere (#5749)

2025-11-13 15:35:41 -08:00

llm_config_overrides.py

fix: update Anthropic Haiku test model after 3.5 retirement (#9569)

2026-02-24 10:55:12 -08:00

llm_config.py

fix: preserve agent max_tokens when caller doesn't explicitly set it (#9679)

2026-03-03 18:34:01 -08:00

llm_trace.py

Add billing context to LLM telemetry traces (#9745)

2026-03-03 18:34:13 -08:00

mcp_server.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

mcp.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

memory_repo.py

feat: git smart HTTP for agent memory repos (#9257)

2026-02-24 10:52:06 -08:00

memory.py

feat(core): sync skills from SKILL.md into memFS blocks (#9718)

2026-03-03 18:34:02 -08:00

message.py

fix: pass images from tool returns to vision models

2026-03-21 12:41:37 -04:00

model.py

fix: add "max" to AnthropicModelSettings effort type (#9754)

2026-03-03 18:34:15 -08:00

npm_requirement.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

organization.py

chore: add new primitive types and replace id_prefixes everywhere (#5749)

2025-11-13 15:35:41 -08:00

passage.py

feat: add batch passage create and optional search query (#8866)

2026-01-29 12:44:04 -08:00

pip_requirement.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

prompt.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

provider_model.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

provider_trace.py

Add billing context to LLM telemetry traces (#9745)

2026-03-03 18:34:13 -08:00

providers.py

chore: delete providers.py (#5223)

2025-10-07 17:50:50 -07:00

response_format.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

run_metrics.py

chore: add new primitive types and replace id_prefixes everywhere (#5749)

2025-11-13 15:35:41 -08:00

run.py

feat: add conversation and conversation_messages tables for concurrent messaging (#8182)

2026-01-12 10:57:48 -08:00

sandbox_config.py

feat: modal tool execution - NO FEATURE FLAGS USES MODAL [LET-4357] (#5120)

2025-11-13 15:36:56 -08:00

secret.py

fix: asyncify encrypt on write (#8339)

2026-01-12 10:57:48 -08:00

source_metadata.py

feat: move sources to folders [LET-6189] (#6199)

2025-11-24 19:09:32 -08:00

source.py

chore: enable F821, F401, W293 (#9503)

2026-02-24 10:55:08 -08:00

step_metrics.py

chore: add new primitive types and replace id_prefixes everywhere (#5749)

2025-11-13 15:35:41 -08:00

step.py

feat: add usage columns to steps table (#9270)

2026-02-24 10:52:06 -08:00

tool_execution_result.py

feat: patch tool calling endpoint and add SDK testing (#6456)

2025-12-15 12:02:19 -08:00

tool_rule.py

chore: add new primitive types and replace id_prefixes everywhere (#5749)

2025-11-13 15:35:41 -08:00

tool.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

usage.py

chore: add ty + pre-commit hook and repeal even more ruff rules (#9504)

2026-02-24 10:55:11 -08:00

user.py

feat: add ID format validation to agent and user schemas (#9151)

2026-02-24 10:52:06 -08:00