Christina Tong 12185c8601 feat: add tools used filtering to internal runs [LET-5415] (#5557) ...

* feat: add tool_used field to run_metrics [LET-5419]

* change to tool name

* use tool ids over names

* feat: add internal runs route with template_family filtering

* feat: add step count filtering to internal runs [LET-5417]

* remove import

* add auto generated

* feat: add tools used filtering to internal runs [LET-5415]

* add test

* add test

* fix snippets

2025-10-24 15:13:47 -07:00

..

configs

chore: Add opus 4-1 and sonnet 4-5 to message v2 testing [LET-5481] (#5406)

2025-10-24 15:11:31 -07:00

data

fix: add back missing files from oss (#4832)

2025-10-07 17:50:45 -07:00

helpers

fix: Fix agent tool graph tests (#4948)

2025-10-07 17:50:46 -07:00

managers

feat: add tools used filtering to internal runs [LET-5415] (#5557)

2025-10-24 15:13:47 -07:00

mcp_tests

fix: mcp schema generation test (#5608)

2025-10-24 15:13:15 -07:00

performance_tests

merge this (#4759)

2025-09-17 15:47:40 -07:00

sdk

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_agent_files

feat: Add parallel tool call streaming for anthropic [LET-4601] (#5225)

2025-10-24 15:11:31 -07:00

test_tool_sandbox

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_tool_schema_parsing_files

merge this (#4759)

2025-09-17 15:47:40 -07:00

__init__.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

clear_postgres_db.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

config.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

conftest.py

chore: rm composio (#5151)

2025-10-07 17:50:49 -07:00

constants.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

integration_test_agent_tool_graph.py

feat: Implement child tool rules args override [LET-4570] (#5060)

2025-10-07 17:50:48 -07:00

integration_test_async_tool_sandbox.py

feat: patch integration test for sandbox [LET-4509] (#4962)

2025-10-07 17:50:46 -07:00

integration_test_batch_api_cron_jobs.py

fix: Fix batch api cron jobs (#4921)

2025-10-07 17:50:46 -07:00

integration_test_batch_sdk.py

feat: Fix test batch sdkpy [LET-4507] (#4917)

2025-10-07 17:50:46 -07:00

integration_test_builtin_tools.py

fix: Fix web search test (#5468)

2025-10-24 15:12:11 -07:00

integration_test_chat_completions.py

feat: Implement streaming chat completions endpoint [LET-5485] (#5446)

2025-10-24 15:12:11 -07:00

integration_test_composio.py

chore: Remove test composio (#4914)

2025-10-07 17:50:46 -07:00

integration_test_human_in_the_loop.py

feat: latest hitl + parallel tool call changes (#5565)

2025-10-24 15:12:49 -07:00

integration_test_mcp.py

fix: fix mcp for complex schemas and add tests (#5063)

2025-10-07 17:50:48 -07:00

integration_test_modal_sandbox_v2.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

integration_test_multi_agent.py

fix: Fix multi agent test (#4947)

2025-10-07 17:50:46 -07:00

integration_test_send_message_v2.py

feat: Add toggle on llm config for parallel tool calling [LET-5610] (#5542)

2025-10-24 15:12:11 -07:00

integration_test_send_message.py

using uuid and datetime [LET-5508] (#5430)

2025-10-24 15:12:11 -07:00

integration_test_sleeptime_agent.py

feat: enable sleeptime on new agent loop (#5405)

2025-10-24 15:11:31 -07:00

integration_test_summarizer.py

fix: patch summarizer tests (#5196)

2025-10-07 17:50:50 -07:00

integration_test_tool_execution_sandbox.py

feat: inject letta_client and agent_id into local sandbox (#5192)

2025-10-24 15:12:11 -07:00

integration_test_turbopuffer.py

feat: create new runs table [LET-4467] (#4841)

2025-10-07 17:50:47 -07:00

integration_test_voice_agent.py

docs: Improve examples page (#5442)

2025-10-24 15:12:11 -07:00

locust_test.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

manual_test_many_messages.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

manual_test_multi_agent_broadcast_large.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

mcp_test.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

mock_mcp_server.py

fix: fix mcp for complex schemas and add tests (#5063)

2025-10-07 17:50:48 -07:00

pytest.ini

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_agent_serialization_v2.py

test: Swap to letta agent v1 for agent serialization (#5464)

2025-10-24 15:12:11 -07:00

test_agent_serialization.py

chore: rm composio (#5151)

2025-10-07 17:50:49 -07:00

test_cli.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_client.py

chore: remove sync db (#4873)

2025-10-07 17:50:45 -07:00

test_crypto_utils.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_embeddings.py

feat: Modify embedding strategy to first halve the batch size v.s. the batc… [LET-5510] (#5434)

2025-10-24 15:12:11 -07:00

test_file_processor.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_google_embeddings.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_letta_agent_batch.py

fix: Fix test letta agent batch (#4918)

2025-10-07 17:50:46 -07:00

test_letta_request_schema.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_llm_clients.py

fix: Patch batch routes (#4916)

2025-10-07 17:50:46 -07:00

test_long_running_agents.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_managers.py

chore: Remove test managers (#4926)

2025-10-07 17:50:46 -07:00

test_mcp_encryption.py

feat: double write to all encrypted columns and decrypt on read (#5265)

2025-10-24 15:11:31 -07:00

test_memory.py

feat: match line number rendering to Anthropic / OAI defaults (#5492)

2025-10-24 15:13:15 -07:00

test_modal_sandbox_v2.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_multi_agent.py

fix: Fix multi agent test (#4947)

2025-10-07 17:50:46 -07:00

test_optimistic_json_parser.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_plugins.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_provider_api.py

feat: allow suers to test their own key [LET-5312] (#5257)

2025-10-09 13:20:53 -07:00

test_provider_trace.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_providers.py

feat: update reasoning toggle test (#5136)

2025-10-07 17:50:49 -07:00

test_redis_client.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_run_status_conversion.py

feat: add status to runs api [PRO-1529] (#5214)

2025-10-07 17:50:50 -07:00

test_schema_validator.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_sdk_client.py

feat: remove un-paginated message list on usage stats [LET-5747] (#5599)

2025-10-24 15:13:15 -07:00

test_secret.py

feat: double write to all encrypted columns and decrypt on read (#5265)

2025-10-24 15:11:31 -07:00

test_server.py

chore: Deprecate test_server (#4913)

2025-10-07 17:50:46 -07:00

test_sonnet_nonnative_reasoning_buffering.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_sources.py

feat: create new runs table [LET-4467] (#4841)

2025-10-07 17:50:47 -07:00

test_static_buffer_summarize.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_stream_buffer_readers.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_timezone_formatting.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

test_tool_rule_solver.py

feat: Implement child tool rules args override [LET-4570] (#5060)

2025-10-07 17:50:48 -07:00

test_tool_schema_parsing.py

feat: support anyOf for structured output tools [LET-5615] (#5556)

2025-10-24 15:13:15 -07:00

test_utils.py

merge this (#4759)

2025-09-17 15:47:40 -07:00

utils.py

merge this (#4759)

2025-09-17 15:47:40 -07:00