cthomas
2d971cdcf0
feat: hold reference to asyncio tasks in memory ( #2823 )
2025-09-10 17:08:07 -07:00
Matthew Zhou
3a551f4bb7
feat: Add turbopuffer embedder by default [LET-4253] ( #4476 )
...
* Adapt to turbopuffer embedder
* Make turbopuffer search more efficient over all source ids
* Combine turbopuffer and pinecone hybrid
* Fix test sources
2025-09-08 18:46:41 -07:00
Matthew Zhou
651671cb83
feat: Support basic upload/querying on tpuf [LET-3465] ( #4255 )
...
* wip implementing turbopuffer
* Move imports up
* Add type of archive
* Integrate turbopuffer functionality
* Debug turbopuffer tests failing
* Fix turbopuffer
* Run fern
* Fix multiple heads
2025-08-28 10:39:16 -07:00
Matthew Zhou
f25844fbe2
fix: Add check status update flag to list ( #4177 )
2025-08-25 16:21:33 -07:00
Matthew Zhou
7f81ac0661
fix: Add asyncio import ( #4147 )
2025-08-24 17:15:41 -07:00
Matthew Zhou
f918ca0a59
feat: Add better error catching for files upload ( #4145 )
2025-08-24 16:46:57 -07:00
Sarah Wooders
53920b08b1
fix: use default embedding ( #4041 )
...
Co-authored-by: Matthew Zhou <mattzh1314@gmail.com >
2025-08-21 21:36:10 -07:00
Matthew Zhou
8095d87df3
feat: Add tests for renaming files ( #4066 )
2025-08-20 16:23:03 -07:00
Matthew Zhou
dc8c6d8246
feat: Allow renaming files on upload ( #4061 )
2025-08-20 13:59:05 -07:00
Matthew Zhou
dc6145f6f2
feat: Add refresh functionality for files ( #4053 )
2025-08-20 13:17:59 -07:00
Matthew Zhou
357e30fc55
fix: Adjust immediate complete for pinecone file state machine ( #3546 )
2025-07-24 14:29:42 -07:00
Matthew Zhou
be7f4be4d8
fix: Fix state transitions for file processing ( #3541 )
2025-07-24 13:48:08 -07:00
Matthew Zhou
410cb24ba9
feat: Add timeout to file processing ( #3513 )
2025-07-24 10:53:13 -07:00
Matthew Zhou
1a4aeb5f9f
feat: Add transition state validation ( #3509 )
2025-07-23 14:08:41 -07:00
Matthew Zhou
cc431b2e97
fix: Fix pinecone embedder ( #3502 )
2025-07-22 23:39:50 -07:00
Matthew Zhou
d446fcbd27
chore: Finish renaming agent serialization manager ( #3497 )
2025-07-22 18:01:00 -07:00
Sarah Wooders
5e9231095a
feat: support markitdown instead of mistral ( #3451 )
...
Co-authored-by: Matt Zhou <mattzh1314@gmail.com >
2025-07-22 09:58:18 -07:00
Matthew Zhou
ef902753b8
feat: Add get agents for source_id endpoint ( #3381 )
2025-07-17 11:47:41 -07:00
Matthew Zhou
8a8aafb3fe
feat: add include_detailed_per_source_metadata flag to sources metadata endpoint ( #3371 )
2025-07-16 17:10:41 -07:00
Matthew Zhou
8d37fa8a6e
fix: Remove limit on Pinecone ( #3299 )
2025-07-11 16:51:07 -07:00
Matthew Zhou
31a9617965
feat: Add duplication handling behavior ( #3273 )
2025-07-10 13:16:01 -07:00
Matthew Zhou
339b9a4cc6
feat: Move 404 catches earlier ( #3257 )
2025-07-09 16:29:17 -07:00
Matthew Zhou
a2e1efe6bc
feat: Add endpoint to get source statistics ( #3206 )
2025-07-07 14:02:44 -07:00
Matthew Zhou
8f1640b2ef
feat: Add batching to record upsert ( #3196 )
2025-07-07 12:18:39 -07:00
Matthew Zhou
e5cb964d90
feat: Make chunking more robust and file type specific ( #3188 )
2025-07-07 11:05:01 -07:00
Matthew Zhou
9605d1f79c
feat: Add pinecone for cloud embedding ( #3160 )
2025-07-03 22:37:55 -07:00
Matthew Zhou
e0c688dc32
feat: Add telemetry for file uploads ( #3128 )
2025-07-01 16:19:58 -07:00
Matthew Zhou
2263ffd07c
feat: Various file fixes and improvements ( #3125 )
2025-07-01 15:21:52 -07:00
Matthew Zhou
804ec12ee2
feat: Only add suffix on duplication ( #3120 )
2025-07-01 13:48:38 -07:00
Matthew Zhou
ccd521f27b
feat: Adjust upload files to return FileMetadata instead of job ( #3031 )
2025-06-25 15:26:35 -07:00
Matthew Zhou
1357736c82
feat: Add endpoint for getting file metadata ( #3024 )
2025-06-25 12:47:31 -07:00
Shangyin Tan
c9841559e8
feat: add optional embedding_config parameter to file upload endpoint ( #2901 )
...
Co-authored-by: Matt Zhou <mattzh1314@gmail.com >
2025-06-18 18:10:48 -07:00
Matthew Zhou
698d99a66e
feat: Ungate file upload for simple MIME types even without Mistral API key ( #2898 )
2025-06-18 15:11:30 -07:00
Matthew Zhou
2568039ab9
feat: Add code file support to file uploads ( #2702 )
2025-06-07 23:45:30 -07:00
cthomas
c300e58db9
chore: create file manager ( #2693 )
2025-06-07 16:14:41 -07:00
Matthew Zhou
f8e2185f37
feat: Add support for simple text files ( #2630 )
2025-06-04 14:36:25 -07:00
Matthew Zhou
fb0dbbdf0d
feat: Store entire parsed file content in separate table ( #2618 )
2025-06-03 18:51:45 -07:00
Matthew Zhou
5886f3819a
feat: Adapt lifecycle management of file <-> agent association ( #2591 )
2025-06-02 17:34:12 -07:00
Matthew Zhou
92fe9123d5
fix: Fix sources tests ( #2575 )
2025-06-01 12:36:41 -07:00
Matthew Zhou
ee8a4c24ab
fix: Gate temporarily to only pdfs/txt/jsons ( #2567 )
2025-05-30 22:14:15 -07:00
Matthew Zhou
9c44b9ae6a
feat: Add mistral for cloud document parsing ( #2562 )
2025-05-30 21:06:28 -07:00
Matthew Zhou
91cd3211ca
feat: Add document block clean up triggers ( #2552 )
2025-05-30 13:34:37 -07:00
Matthew Zhou
e19955db6f
feat: Insert file blocks for agent on source attach ( #2545 )
2025-05-30 11:09:59 -07:00
Kevin Lin
ed4b28f3e4
feat: Add files into agent context window on file upload ( #1852 )
...
Co-authored-by: Caren Thomas <carenthomas@gmail.com >
Co-authored-by: Matt Zhou <mattzh1314@gmail.com >
2025-05-29 18:19:23 -07:00
cthomas
207e6e5bbe
feat(asyncify): delete source sleeptime ( #2459 )
2025-05-27 12:41:57 -07:00
cthomas
b534bb7d15
feat(asyncify): sleeptime doc ingest ( #2455 )
2025-05-27 11:33:36 -07:00
Shubham Naik
e8768a6e59
fix: data source count error ( #2450 )
...
Co-authored-by: Shubham Naik <shub@memgpt.ai >
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com >
2025-05-27 10:17:07 -07:00
cthomas
4dff6b648a
feat(asyncify): migrate upload and attach source ( #2432 )
2025-05-25 23:09:14 -07:00
cthomas
02685db77f
feat(asyncify): convert actor load in sources count ( #2428 )
2025-05-25 21:52:16 -07:00
cthomas
af11c7bffc
feat(asyncify): migrate actor loads in sources routes ( #2372 )
2025-05-23 09:38:34 -07:00
