Matthew Zhou
fa38bad3aa
feat: Filter out empty chunks in Turbopuffer embedding ( #2842 )
2025-09-11 14:52:39 -07:00
Matthew Zhou
3a551f4bb7
feat: Add turbopuffer embedder by default [LET-4253] ( #4476 )
...
* Adapt to turbopuffer embedder
* Make turbopuffer search more efficient over all source ids
* Combine turbopuffer and pinecone hybrid
* Fix test sources
2025-09-08 18:46:41 -07:00
Matthew Zhou
531eb6afeb
feat: Add project_id to message filtering/inserting to Turbopuffer [LET-4252] ( #4466 )
...
* Add project_id
* Fern autogen
2025-09-08 14:35:15 -07:00
Matthew Zhou
fb0e2d91a2
feat: Write tests for search messages [LET-4212] ( #4447 )
...
* Adjust naming
* Add testing and improve message search
* Adjust comments
* Change query text to query
* Fern autogen
2025-09-05 17:52:13 -07:00
Matthew Zhou
2e3cabc080
feat: Add search messages endpoint [LET-4144] ( #4434 )
...
* Add search messages endpoint
* Run fern autogen and fix tests
2025-09-05 14:28:27 -07:00
Matthew Zhou
fcfc40eaf2
feat: Add project id to message schema [LET-4166] ( #4433 )
...
* Add project id
* Propogate through update message by id async
* Add project id testing
2025-09-04 16:50:41 -07:00
Matthew Zhou
ba3843031e
feat: Make end date inclusive on conversation search ( #4431 )
...
Make end date inclusive
2025-09-04 15:26:49 -07:00
Matthew Zhou
b8d403c962
feat: Add ranks to archival memory search [LET-4193] ( #4426 )
...
* Add ranks to archival memory search
* Fix test managers
* Fix archival memory test
2025-09-04 13:35:54 -07:00
Matthew Zhou
25d37e2ac9
fix: change to pure rank-based RRF for relevance ordering ( #4411 )
...
* Fix RRF
* Fix turbopuffer tests
2025-09-03 17:33:19 -07:00
Matthew Zhou
88831c7256
feat: Change namespace to be org scoped and filter on agent_id [LET-4163] ( #4368 )
...
* Change to org scoped and agent_id filtering
* Finish modifying conversation search tool
* Fix failing tests
* Get rid of bad imports
2025-09-03 10:00:19 -07:00
Matthew Zhou
75d444c335
feat: Extend crud lifecycle of messages [LET-4158] ( #4364 )
...
Extend crud lifecycle of messages
2025-09-02 14:38:30 -07:00
Matthew Zhou
00fd8617a6
feat: Add association for the vector namespace [LET-4148] ( #4354 )
...
Add association for the namespace
2025-09-02 13:21:42 -07:00
Matthew Zhou
20ac2923ff
feat: Embed all messages in turbopuffer [LET-4143] ( #4352 )
...
* wip
* Finish embedding
* Fix ruff and tests
2025-09-02 12:43:48 -07:00
Matthew Zhou
335e0c2be1
feat: Support timestamp filtering for archival memories [LET-3469] ( #4330 )
...
Finish temporal filtering
2025-08-30 19:31:07 -07:00
Kian Jones
2b80b4aad8
chore: add tbpuf secrets and testing ( #4292 )
...
* add tbpuf secret
* deploy tbpuf key to prod deploy for core
* add secrets in staging and ci
* rn turbopuff test and add to integration test suite
* add tbpuf
* rename all occurences to tpuf
* remove debug prints
* buffer-puf
* add letta prefix
* add debug
* fix tests
2025-08-29 16:44:15 -07:00
Matthew Zhou
23b2769dc4
feat: Allow agent archival tools to insert/search with tags [LET-4072] ( #4300 )
...
* Finish modifying archival memory tools
* Add tags
* Add disabled test
2025-08-29 11:55:06 -07:00
Matthew Zhou
016feda83a
feat: Support arbitrary string tagging filtering [LET-3467] ( #4285 )
...
* Finish tagging
* Add comprehensive tags functionality
* Add fern autogen
* Create passage tags table
* Add indices
* Add comments explaining dual storage
* Fix alembic heads
* Fix alembic
---------
Co-authored-by: Kian Jones <11655409+kianjones9@users.noreply.github.com >
2025-08-28 16:57:36 -07:00
Matthew Zhou
2791be982a
feat: Add hybrid search on turbopuffer [LET-4096] ( #4284 )
...
Add hybrid search
2025-08-28 13:10:25 -07:00
Matthew Zhou
651671cb83
feat: Support basic upload/querying on tpuf [LET-3465] ( #4255 )
...
* wip implementing turbopuffer
* Move imports up
* Add type of archive
* Integrate turbopuffer functionality
* Debug turbopuffer tests failing
* Fix turbopuffer
* Run fern
* Fix multiple heads
2025-08-28 10:39:16 -07:00