Kian Jones
b8e9a80d93
merge this ( #4759 )
...
* wait I forgot to comit locally
* cp the entire core directory and then rm the .git subdir
2025-09-17 15:47:40 -07:00
Kian Jones
22f70ca07c
chore: officially migrate to submodule ( #4502 )
...
* remove apps/core and apps/fern
* fix precommit
* add submodule updates in workflows
* submodule
* remove core tests
* update core revision
* Add submodules: true to all GitHub workflows
- Ensure all workflows can access git submodules
- Add submodules support to deployment, test, and CI workflows
- Fix YAML syntax issues in workflow files
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
* remove core-lint
* upgrade core with latest main of oss
---------
Co-authored-by: Claude <noreply@anthropic.com >
2025-09-09 12:45:53 -07:00
Matthew Zhou
516f2963e0
feat: Add turbopuffer embedder by default [LET-4253] ( #4476 )
...
* Adapt to turbopuffer embedder
* Make turbopuffer search more efficient over all source ids
* Combine turbopuffer and pinecone hybrid
* Fix test sources
2025-09-08 18:46:41 -07:00
Matthew Zhou
d078100a89
fix: Remove possibility of empty strings when updating ( #4149 )
2025-08-24 17:28:11 -07:00
Matthew Zhou
2f87cd4393
feat: Polishing open files tools ( #3575 )
...
Co-authored-by: Charles Packer <packercharles@gmail.com >
Co-authored-by: Shubham Naik <shub@letta.com >
Co-authored-by: Shubham Naik <shub@memgpt.ai >
Co-authored-by: cthomas <caren@letta.com >
Co-authored-by: jnjpng <jin@letta.com >
Co-authored-by: Jin Peng <jinjpeng@Jins-MacBook-Pro.local >
Co-authored-by: Cameron Pfiffer <cameron@pfiffer.org >
Co-authored-by: Kian Jones <11655409+kianjones9@users.noreply.github.com >
Co-authored-by: Kian Jones <kian@Kians-MacBook-Pro.local >
2025-07-29 15:46:51 -07:00
Matthew Zhou
0998fe2591
fix: Adjust immediate complete for pinecone file state machine ( #3546 )
2025-07-24 14:29:42 -07:00
Matthew Zhou
d629f47d75
fix: Fix state transitions for file processing ( #3541 )
2025-07-24 13:48:08 -07:00
Matthew Zhou
d74db3e89a
feat: Add transition state validation ( #3509 )
2025-07-23 14:08:41 -07:00
Matthew Zhou
9f8258c058
fix: Fix pinecone embedder ( #3502 )
2025-07-22 23:39:50 -07:00
Matthew Zhou
7e3c9bf624
chore: Finish renaming agent serialization manager ( #3497 )
2025-07-22 18:01:00 -07:00
Andy Li
58081e3cea
feat: support for providers
2025-07-22 16:09:50 -07:00
Sarah Wooders
f2495ce727
feat: support markitdown instead of mistral ( #3451 )
...
Co-authored-by: Matt Zhou <mattzh1314@gmail.com >
2025-07-22 09:58:18 -07:00
Kevin Lin
b0302d60ec
feat: pass in embedding chunk size ( #3323 )
2025-07-21 15:11:28 -07:00
Matthew Zhou
e2a6f94b60
feat: Support exporting/importing sources and files for agent file ( #3414 )
2025-07-18 16:20:18 -07:00
Matthew Zhou
9273ed4ab8
feat: Fix empty splitlines bug ( #3317 )
2025-07-14 10:50:15 -07:00
Matthew Zhou
1643739305
feat: Improve performance on files related data models ( #3285 )
2025-07-10 18:00:35 -07:00
Andy Li
2ddd048e5c
chore: sentry log grouping and file upload stats
2025-07-09 10:29:23 -07:00
Matthew Zhou
1d9b4a789d
feat: Add error on out of range for open_files ( #3214 )
2025-07-07 16:40:25 -07:00
Matthew Zhou
375b2b5032
feat: Further split structured documents ( #3199 )
2025-07-07 13:22:50 -07:00
Andy Li
9a7a8071a6
chore: proper logging for sentry ( #3195 )
2025-07-07 12:37:39 -07:00
Matthew Zhou
0312ee05bc
feat: Make chunking more robust and file type specific ( #3188 )
2025-07-07 11:05:01 -07:00
Sarah Wooders
bdd45a19ef
chore: reduce logger.error to logger.debug for file upload ( #3186 )
2025-07-07 09:49:31 -07:00
Matthew Zhou
954675396f
feat: Add pinecone for cloud embedding ( #3160 )
2025-07-03 22:37:55 -07:00
Matthew Zhou
96e8c292cd
fix: Change to only derive json_schema for custom tools if missing ( #3129 )
2025-07-01 17:13:31 -07:00
Matthew Zhou
483d9559c8
feat: Add telemetry for file uploads ( #3128 )
2025-07-01 16:19:58 -07:00
Matthew Zhou
d064077f4d
feat: Finish batch size param on embedding config ( #3115 )
2025-07-01 13:41:49 -07:00
Matthew Zhou
bccbf75520
feat: Add csv support for files ( #3077 )
2025-06-27 15:04:24 -07:00
Matthew Zhou
9bb80194fe
feat: Rework and simplify files tooling ( #3058 )
2025-06-27 13:23:44 -07:00
Matthew Zhou
d8343ba51f
feat: Adjust upload files to return FileMetadata instead of job ( #3031 )
2025-06-25 15:26:35 -07:00
Matthew Zhou
49877f00dd
feat: Attach file blocks when creating an agent with source ( #3027 )
2025-06-25 14:08:00 -07:00
Matthew Zhou
bf76d91d6b
feat: Use default letta embedder if OpenAI key is not provided ( #2899 )
2025-06-18 15:23:43 -07:00
Matthew Zhou
a3c054bc92
feat: Ungate file upload for simple MIME types even without Mistral API key ( #2898 )
2025-06-18 15:11:30 -07:00
Matthew Zhou
d5d71a776a
feat: Parallel web search tool ( #2890 )
2025-06-18 14:07:51 -07:00
Matthew Zhou
951773d0ec
feat: Add content aware line chunking ( #2707 )
2025-06-09 13:03:25 -07:00
Matthew Zhou
24b89802ea
feat: Add code file support to file uploads ( #2702 )
2025-06-07 23:45:30 -07:00
cthomas
82dd311011
chore: create file manager ( #2693 )
2025-06-07 16:14:41 -07:00
Matthew Zhou
a155d9bdd5
feat: Implement grep tool ( #2694 )
2025-06-06 17:36:49 -07:00
Matthew Zhou
6610c0b859
feat: Search files returns citations of the filenames that were searched ( #2689 )
2025-06-06 15:34:03 -07:00
Matthew Zhou
841aad48ae
feat: Add file metadata processing status ( #2665 )
2025-06-06 11:11:39 -07:00
Matthew Zhou
971433f9d5
feat: Add line metadata and warnings to file blocks ( #2663 )
2025-06-05 17:02:28 -07:00
Matthew Zhou
bbdfc3f2cd
feat: Add support for simple text files ( #2630 )
2025-06-04 14:36:25 -07:00
Matthew Zhou
3d8704395b
feat: Store entire parsed file content in separate table ( #2618 )
2025-06-03 18:51:45 -07:00
Matthew Zhou
1c14d25fe6
feat: Adapt lifecycle management of file <-> agent association ( #2591 )
2025-06-02 17:34:12 -07:00
Matthew Zhou
aaf06174f8
feat: Add mistral for cloud document parsing ( #2562 )
2025-05-30 21:06:28 -07:00
