Commit Graph

2099 Commits

Author SHA1 Message Date
cthomas
ed74c595a6 feat: ensure trailing thinking block doesn't break token counter (#5271)
* repro pr for claude 4-5 only returns reasoning

* add new test instead of overloading existing one

* update test

* filter out trailing thinking message to patch context bug
2025-10-09 13:20:53 -07:00
Shubham Naik
7eae22f77c feat: allow suers to test their own key [LET-5312] (#5257)
* feat: allow suers to test their own key

* chore: add unit test

---------

Co-authored-by: Shubham Naik <shub@memgpt.ai>
2025-10-09 13:20:53 -07:00
Matthew Zhou
609e63cb12 feat: Adjust message conversion to support multiple tool calls [LET-5336] (#5270)
* Adjust message conversion

* Make collection logic cleaner
2025-10-09 13:20:52 -07:00
cthomas
9cb5156ac7 chore: sync 0.12.0 version (#3023)
Co-authored-by: Matthew Zhou <mattzh1314@gmail.com>
Co-authored-by: Kian Jones <11655409+kianjones9@users.noreply.github.com>
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
2025-10-08 16:10:51 -07:00
Caren Thomas
a5354d7534 chore: bump version 0.11.8 2025-10-07 18:31:26 -07:00
Shelley Pham
346db5ce60 feat: add status to runs api [PRO-1529] (#5214) 2025-10-07 17:50:50 -07:00
Matthew Zhou
126e51d584 feat: Support returning multiple tool returns [LET-4678] (#5202)
* Support returning multiple tool returns

* Fix test run managers
2025-10-07 17:50:50 -07:00
Sarah Wooders
324933edd3 feat: exception handling middleware for sandbox_configs + identities + tools (#5143) 2025-10-07 17:50:50 -07:00
Sarah Wooders
307c85ca9a fix: patch summarizer tests (#5196) 2025-10-07 17:50:50 -07:00
cthomas
a7fa6bb33f feat: amend hitl tests for new agent loop (#5176) 2025-10-07 17:50:49 -07:00
Sarah Wooders
7aff9aa659 feat: error handling for rest api for agents + blocks [LET-4625] (#5142) 2025-10-07 17:50:49 -07:00
Sarah Wooders
e07a589796 chore: rm composio (#5151) 2025-10-07 17:50:49 -07:00
Charles Packer
10a301cc4b fix: use new agent loop in hitl test (#5145)
* feat: rewrite hitl test with new agent loop

* fix: codex changes (#5144)

---------

Co-authored-by: Caren Thomas <carenthomas@gmail.com>
2025-10-07 17:50:49 -07:00
cthomas
2d8e3efd9e feat: update reasoning toggle test (#5136) 2025-10-07 17:50:49 -07:00
cthomas
89321ff29a feat: handle flaky reasoning in v2 tests (#5133) 2025-10-07 17:50:49 -07:00
cthomas
93d9ff01c6 feat: add gemini native thinking (#5124)
* feat: add gemini native thinking

* update test

* revert comments
2025-10-07 17:50:49 -07:00
Sarah Wooders
eb95c1330e fix: patch summarizer for gpt-5 [LET-4562] (#5040) 2025-10-07 17:50:48 -07:00
Sarah Wooders
ef07e03ee3 feat: add run_id to input messages and step_id to messages (#5099) 2025-10-07 17:50:48 -07:00
Sarah Wooders
7b73b25a95 fix: fix mcp for complex schemas and add tests (#5063) 2025-10-07 17:50:48 -07:00
Matthew Zhou
b5e848ff18 feat: Implement child tool rules args override [LET-4570] (#5060)
* Implement child tool rules args override

* Add zod types

* Run fern autogen and put ToolCallNode in new field

* Fix test_tool_rule_solver.py

* Fix types

* Fix types again

* Add tests to tool rule solver
2025-10-07 17:50:48 -07:00
Matthew Zhou
803b837c64 feat: Support pre-filling arguments on InitToolRule [LET-4569] (#5057)
* Add args

* Add testing to tool rule solver

* Add live integration tests for args prefilling

* Add args override
2025-10-07 17:50:48 -07:00
cthomas
a3545110cf feat: add full responses api support in new agent loop (#5051)
* feat: add full responses api support in new agent loop

* update matrix in workflow

* relax check for reasoning messages for high effort gpt 5

* fix indent

* one more relax
2025-10-07 17:50:48 -07:00
cthomas
ad42c886b7 feat: add new agent loop tests to ci (#5049) 2025-10-07 17:50:48 -07:00
Matthew Zhou
df5c997da0 feat: Enable dynamic toggling of tool choice in v3 agent loop for OpenAI [LET-4564] (#5042)
* Add subsequent flag

* Finish integrating constrained/unconstrained toggling on v3 agent loop

* Update tests to run on v3

* Run lint
2025-10-07 17:50:47 -07:00
cthomas
f235dfb356 feat: add tool call test for new agent loop (#5034) 2025-10-07 17:50:47 -07:00
Matthew Zhou
bc2218b0ca feat: Add should_force_tool_call to tool rule solver (#5032)
Add  to tool rule solver
2025-10-07 17:50:47 -07:00
cthomas
cd900a6f4d feat: check run completion in send message tests (#5030) 2025-10-07 17:50:47 -07:00
cthomas
2d36002fc5 feat: add background mode test for new agent loop (#5025) 2025-10-07 17:50:47 -07:00
cthomas
e248ac27e2 feat: add messages.create_async test for new agent loop (#5024)
feat: add async test for new agent loop
2025-10-07 17:50:47 -07:00
cthomas
2af3130be1 feat: add integration test for new agent loop (#5020) 2025-10-07 17:50:47 -07:00
cthomas
4173de955d test: add reasoning toggle tests for new agent type (#5000) 2025-10-07 17:50:47 -07:00
cthomas
e5d364d043 fix: test sdk client fixtures (#4997)
* fix: test sdk client fixtures

* make server fixture not async
2025-10-07 17:50:47 -07:00
Sarah Wooders
354205f581 feat: create new runs table [LET-4467] (#4841) 2025-10-07 17:50:47 -07:00
Charles Packer
1c7448eb9d fix: patch remaining failing send_message CI tests (#4974)
* fix: patch failing summarizer tests for anthropic claude 3.5

* fix: carveout for gemini-2.5-flash because it doesn't do the send_message tool call

* fix: deprecate old gemini test now that model is unavailable

* fix: deprecate old gemini test now that model is unavailable

* fix: deprecate old gemini test now that model is unavailable

* fix: patch flash flakiness

* fix: relax the gemini 2.5 flash test

* fix: relax the gemini 2.5 flash test

* fix: relax again

* fix: another flash fix

* fix: relax gpt-4o-mini

* fix: swap 4o-mini for 4.1

* fix: drop 4o-mini
2025-10-07 17:50:46 -07:00
Sarah Wooders
d0d36a4b07 fix: remove json schema generation from tool validation [LET-4509] (#4964)
* patch integration test

* create default user and org

* rm

* patch

* add testing

* remove validation for schemas from pydantic object

* add file

* patch tests

* fix more tests

* fix managers

* fix sdk test

* patch schema tests

* Comment out name in update

* patch test

* patch

* add another test
2025-10-07 17:50:46 -07:00
Sarah Wooders
18abcc7025 feat: patch integration test for sandbox [LET-4509] (#4962)
* patch integration test

* create default user and org

* rm

* patch
2025-10-07 17:50:46 -07:00
Matthew Zhou
6d71a606aa test: Test archive manager thoroughly (#4955)
Test archive manager thoroughly
2025-10-07 17:50:46 -07:00
Matthew Zhou
155fa9c734 fix: Fix agent tool graph tests (#4948)
Fix agent tool graph tests
2025-10-07 17:50:46 -07:00
Matthew Zhou
b5053d02d5 fix: Fix multi agent test (#4947)
Fix multi agent
2025-10-07 17:50:46 -07:00
Charles Packer
81bf132712 fix: disable reasoning toggle when agent type is letta agent v1 [PRO-1346] (#4946)
* fix: change the backend logic for the reasoning toggle to be different for v1 vs old agent types, also change the frontend to disable toggling unless it's a toggle-able model

* fix: add more logic to when the reasoning switch is enabled or disabled

* fix: safety net in the backend to set config when undefined

* fix: disable prefix fill, it's a bug
2025-10-07 17:50:46 -07:00
Matthew Zhou
a9b18cf67c chore: Remove test managers (#4926)
Remove test managers
2025-10-07 17:50:46 -07:00
Matthew Zhou
96deccc45d fix: Remove integration test summarizer (#4925)
Remove integration test summarizer
2025-10-07 17:50:46 -07:00
Matthew Zhou
26f94d567f fix: Fix batch api cron jobs (#4921)
Fix batch api cron jobs
2025-10-07 17:50:46 -07:00
Matthew Zhou
fa5415f0e3 fix: Fix test embeddings (#4920)
Fix test embeddings
2025-10-07 17:50:46 -07:00
Matthew Zhou
c31efe1517 fix: Fix test letta agent batch (#4918)
Test letta agent batch
2025-10-07 17:50:46 -07:00
Matthew Zhou
d78e0ccb58 feat: Fix test batch sdkpy [LET-4507] (#4917)
* Fix test batch sdk

* Consolidate and fix test batch sdk
2025-10-07 17:50:46 -07:00
Matthew Zhou
b0bc04fec7 fix: Patch batch routes (#4916)
Patch batch routes
2025-10-07 17:50:46 -07:00
Sarah Wooders
53786ee102 feat: asyncify test_manager.py [LET-4494] (#4890)
* add test_agent_manager.py

* created shared conftest

* add test_tool_manager.py

* add tag tests

* add message manager tests

* add blocks

* add org

* add passage tests

* add archive manager

* add user manager

* add identity

* add job manager tests

* add sandbox manager

* add file manager

* add group managers

* add mcp manager

* fix batch tests

* update workflows

* fix test_managers.py

* more tests

* comment out old test and add file

---------

Co-authored-by: Matthew Zhou <mattzh1314@gmail.com>
2025-10-07 17:50:46 -07:00
Matthew Zhou
3e2eba1b07 chore: Remove test composio (#4914)
Remove test composio
2025-10-07 17:50:46 -07:00
Matthew Zhou
ee0170e446 chore: Deprecate test_server (#4913)
Deprecate test_server
2025-10-07 17:50:46 -07:00