Kian Jones
f5c4ab50f4
chore: add ty + pre-commit hook and repeal even more ruff rules ( #9504 )
...
* auto fixes
* auto fix pt2 and transitive deps and undefined var checking locals()
* manual fixes (ignored or letta-code fixed)
* fix circular import
* remove all ignores, add FastAPI rules and Ruff rules
* add ty and precommit
* ruff stuff
* ty check fixes
* ty check fixes pt 2
* error on invalid
2026-02-24 10:55:11 -08:00
Kian Jones
25d54dd896
chore: enable F821, F401, W293 ( #9503 )
...
* auto fixes
* auto fix pt2 and transitive deps and undefined var checking locals()
* manual fixes (ignored or letta-code fixed)
* fix circular import
2026-02-24 10:55:08 -08:00
Kian Jones
0099a95a43
fix(sec): first pass of ensuring actor id is required everywhere ( #9126 )
...
first pass of ensuring actor id is required
2026-01-29 12:44:04 -08:00
cthomas
cfde955313
feat: prevent unbounded file queries ( #8285 )
2026-01-12 10:57:48 -08:00
Kian Jones
94c2921711
chore: walk back some temporary debugging stuff ( #6332 )
...
* first pass
* uv lock
2025-11-24 19:10:27 -08:00
cthomas
345ea42630
feat: offload all file i/o in server endpoints LET-6252 ( #6300 )
...
feat: offload all file i/o in server endpoints
2025-11-24 19:10:26 -08:00
Kian Jones
848aa962b6
feat: add memory tracking to core ( #6179 )
...
* add memory tracking to core
* move to asyncio from threading.Thread
* remove threading.thread all the way
* delay decorator monitoring initialization until after event loop is registered
* context manager to decorator
* add psutil
2025-11-24 19:09:32 -08:00
Matthew Zhou
8df78e9429
feat: Move file upload to temporal [LET-6089] ( #6024 )
...
* Finish writing temporal upload file activity
* Remove prints
* Rewrite content re-use
2025-11-13 15:36:55 -08:00
Kian Jones
6c377cdc81
chore(logs): Add resource usage logging to streaming, file uploads, mcp client, and model caches ( #5925 )
...
* adding log messages to track memory consumption
* add logging to sources, folders, agentfiles, and mcp clients
* memory logging for tool creation paths
2025-11-13 15:36:50 -08:00
Kian Jones
bbaaabb6e1
fix: path validator had weird fastapi shared object memory bug ( #5594 )
...
* fix weird path param conflict
* move to factory model
* openapi
* use type hinting and import annotations
* re add after mc resolution
2025-10-24 15:13:15 -07:00
Kian Jones
448ba33c70
fix: source id from pydantic base class rather than expected string id ( #5554 )
...
* first pass
* hacky fix bc of path import
2025-10-24 15:12:26 -07:00
Kian Jones
3ac7cde434
feat: add path parameter validation for source_id ( #5524 )
...
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Claude <noreply@anthropic.com >
2025-10-24 15:12:11 -07:00
Kian Jones
47bf549dfc
feat: add path parameter validation for file_id ( #5522 )
...
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Claude <noreply@anthropic.com >
2025-10-24 15:12:11 -07:00
Ari Webb
967cc3decf
move exceptions out of folders and sources [LET-4631] ( #5444 )
2025-10-24 15:12:11 -07:00
cthomas
401293c48b
feat: mark sources routes as deprecated LET-4381 ( #2938 )
2025-09-15 20:49:11 -07:00
cthomas
0776a236c8
feat: add new header dependency in all routes ( #2905 )
2025-09-15 14:33:08 -07:00
cthomas
2d971cdcf0
feat: hold reference to asyncio tasks in memory ( #2823 )
2025-09-10 17:08:07 -07:00
Matthew Zhou
3a551f4bb7
feat: Add turbopuffer embedder by default [LET-4253] ( #4476 )
...
* Adapt to turbopuffer embedder
* Make turbopuffer search more efficient over all source ids
* Combine turbopuffer and pinecone hybrid
* Fix test sources
2025-09-08 18:46:41 -07:00
Matthew Zhou
651671cb83
feat: Support basic upload/querying on tpuf [LET-3465] ( #4255 )
...
* wip implementing turbopuffer
* Move imports up
* Add type of archive
* Integrate turbopuffer functionality
* Debug turbopuffer tests failing
* Fix turbopuffer
* Run fern
* Fix multiple heads
2025-08-28 10:39:16 -07:00
Matthew Zhou
f25844fbe2
fix: Add check status update flag to list ( #4177 )
2025-08-25 16:21:33 -07:00
Matthew Zhou
7f81ac0661
fix: Add asyncio import ( #4147 )
2025-08-24 17:15:41 -07:00
Matthew Zhou
f918ca0a59
feat: Add better error catching for files upload ( #4145 )
2025-08-24 16:46:57 -07:00
Sarah Wooders
53920b08b1
fix: use default embedding ( #4041 )
...
Co-authored-by: Matthew Zhou <mattzh1314@gmail.com >
2025-08-21 21:36:10 -07:00
Matthew Zhou
8095d87df3
feat: Add tests for renaming files ( #4066 )
2025-08-20 16:23:03 -07:00
Matthew Zhou
dc8c6d8246
feat: Allow renaming files on upload ( #4061 )
2025-08-20 13:59:05 -07:00
Matthew Zhou
dc6145f6f2
feat: Add refresh functionality for files ( #4053 )
2025-08-20 13:17:59 -07:00
Matthew Zhou
357e30fc55
fix: Adjust immediate complete for pinecone file state machine ( #3546 )
2025-07-24 14:29:42 -07:00
Matthew Zhou
be7f4be4d8
fix: Fix state transitions for file processing ( #3541 )
2025-07-24 13:48:08 -07:00
Matthew Zhou
410cb24ba9
feat: Add timeout to file processing ( #3513 )
2025-07-24 10:53:13 -07:00
Matthew Zhou
1a4aeb5f9f
feat: Add transition state validation ( #3509 )
2025-07-23 14:08:41 -07:00
Matthew Zhou
cc431b2e97
fix: Fix pinecone embedder ( #3502 )
2025-07-22 23:39:50 -07:00
Matthew Zhou
d446fcbd27
chore: Finish renaming agent serialization manager ( #3497 )
2025-07-22 18:01:00 -07:00
Sarah Wooders
5e9231095a
feat: support markitdown instead of mistral ( #3451 )
...
Co-authored-by: Matt Zhou <mattzh1314@gmail.com >
2025-07-22 09:58:18 -07:00
Matthew Zhou
ef902753b8
feat: Add get agents for source_id endpoint ( #3381 )
2025-07-17 11:47:41 -07:00
Matthew Zhou
8a8aafb3fe
feat: add include_detailed_per_source_metadata flag to sources metadata endpoint ( #3371 )
2025-07-16 17:10:41 -07:00
Matthew Zhou
8d37fa8a6e
fix: Remove limit on Pinecone ( #3299 )
2025-07-11 16:51:07 -07:00
Matthew Zhou
31a9617965
feat: Add duplication handling behavior ( #3273 )
2025-07-10 13:16:01 -07:00
Matthew Zhou
339b9a4cc6
feat: Move 404 catches earlier ( #3257 )
2025-07-09 16:29:17 -07:00
Matthew Zhou
a2e1efe6bc
feat: Add endpoint to get source statistics ( #3206 )
2025-07-07 14:02:44 -07:00
Matthew Zhou
8f1640b2ef
feat: Add batching to record upsert ( #3196 )
2025-07-07 12:18:39 -07:00
Matthew Zhou
e5cb964d90
feat: Make chunking more robust and file type specific ( #3188 )
2025-07-07 11:05:01 -07:00
Matthew Zhou
9605d1f79c
feat: Add pinecone for cloud embedding ( #3160 )
2025-07-03 22:37:55 -07:00
Matthew Zhou
e0c688dc32
feat: Add telemetry for file uploads ( #3128 )
2025-07-01 16:19:58 -07:00
Matthew Zhou
2263ffd07c
feat: Various file fixes and improvements ( #3125 )
2025-07-01 15:21:52 -07:00
Matthew Zhou
804ec12ee2
feat: Only add suffix on duplication ( #3120 )
2025-07-01 13:48:38 -07:00
Matthew Zhou
ccd521f27b
feat: Adjust upload files to return FileMetadata instead of job ( #3031 )
2025-06-25 15:26:35 -07:00
Matthew Zhou
1357736c82
feat: Add endpoint for getting file metadata ( #3024 )
2025-06-25 12:47:31 -07:00
Shangyin Tan
c9841559e8
feat: add optional embedding_config parameter to file upload endpoint ( #2901 )
...
Co-authored-by: Matt Zhou <mattzh1314@gmail.com >
2025-06-18 18:10:48 -07:00
Matthew Zhou
698d99a66e
feat: Ungate file upload for simple MIME types even without Mistral API key ( #2898 )
2025-06-18 15:11:30 -07:00
Matthew Zhou
2568039ab9
feat: Add code file support to file uploads ( #2702 )
2025-06-07 23:45:30 -07:00
