Commit Graph

48 Commits

Author SHA1 Message Date
Matthew Zhou
8d7ff5a536 feat: Reverse inner thoughts for chat completions endpoint (#1081) 2025-02-20 12:30:34 -08:00
cthomas
ae282baacc feat: add tracing (#883) 2025-02-18 19:03:31 -08:00
Kevin Lin
98f0062416 feat: support deepseek models (#821)
Co-authored-by: Charles Packer <packercharles@gmail.com>
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
Co-authored-by: Shubham Naik <shub@memgpt.ai>
Co-authored-by: Shubham Naik <shub@letta.com>
2025-02-18 15:28:01 -08:00
Matthew Zhou
3a4d6b4a7a feat: Fix VLLM tool_choice (#1001) 2025-02-14 11:59:32 -08:00
Sarah Wooders
42ac85efa8 feat: google vertex integration (#980) 2025-02-12 18:06:26 -08:00
Charles Packer
be0aa0d7d2 fix: add prefix fill support for Claude to try and boost haiku performance (#958) 2025-02-10 22:36:47 -08:00
Kevin Lin
22484082ee fix: add max tokens (#795)
Co-authored-by: Charles Packer <packercharles@gmail.com>
2025-02-10 20:28:03 -08:00
Matthew Zhou
b981b617e1 fix: Disable default OpenAI retry behavior (#856) 2025-01-30 11:37:47 -08:00
cpacker
34e3cd44cd fix: pass in a dummy key to openai python client if it doesn't exist at inference time 2025-01-29 17:55:54 -08:00
Matthew Zhou
71620c1303 feat: Use Async OpenAI client to prevent blocking server thread (#811) 2025-01-28 14:02:33 -08:00
mlong93
669e8c79af feat: add anthropic streaming (#716)
Co-authored-by: Mindy Long <mindy@letta.com>
Co-authored-by: Charles Packer <packercharles@gmail.com>
2025-01-26 17:35:22 -08:00
Kevin Lin
38b7c1ec9a chore: add temperature to LLMConfig (#735)
Co-authored-by: Charles Packer <packercharles@gmail.com>
2025-01-23 15:55:47 -08:00
Matthew Zhou
9a5d591515 feat: Use official OpenAI client (#752) 2025-01-23 15:45:06 -08:00
mlong93
19dbc9691a chore: Migrate to anthropic sdk (#693)
Co-authored-by: Mindy Long <mindy@letta.com>
2025-01-17 15:22:01 -08:00
mlong93
02cca70d78 feat: add support for AWS Bedrock (Anthropic) (#689)
Co-authored-by: Mindy Long <mindy@letta.com>
2025-01-17 11:42:21 -08:00
cthomas
4047f02386 feat: support custom api keys for cloud (#533) 2025-01-07 22:12:55 -08:00
Matthew Zhou
5c490a3cc7 chore: Merge OSS (#512) 2025-01-06 10:46:53 -08:00
Caren Thomas
7144fd2867 run black, add isort config to pyproject.toml 2024-12-26 19:43:11 -08:00
Caren Thomas
905906d416 run isort on apps/core 2024-12-26 19:27:09 -08:00
Shubham Naik
4cf354c033 fix: add tests to cypress 2024-12-23 14:44:08 -08:00
cthomas
0792887527 feat: add new RateLimitExceededError (#2277)
Co-authored-by: Caren Thomas <caren@caren-mac.local>
2024-12-18 17:15:40 -08:00
mlong93
91995ae6ff feat: Adding init tool rule for Anthropic endpoint (#2262)
Co-authored-by: Mindy Long <mindy@letta.com>
2024-12-17 15:21:10 -08:00
Charles Packer
85d3e649ee fix: add a special error type for configuration errors (#2198) 2024-12-08 17:04:04 -08:00
Charles Packer
a75dfd7907 fix: context window overflow patch (#2053) 2024-11-18 15:21:11 -08:00
Charles Packer
f57dc28552 feat: support togetherAI via /completions (#2045) 2024-11-18 15:15:05 -08:00
Matthew Zhou
7bb0f53c23 feat: Implement tool calling rules for agents (#1954) 2024-10-30 16:53:41 -07:00
Matthew Zhou
9439e5e255 fix: Clean up some legacy code and fix Groq provider (#1950) 2024-10-28 14:13:11 -07:00
Charles Packer
e940511a6f revert: Revert "feat: fix streaming put_inner_thoughts_in_kwargs" (#1912) 2024-10-19 23:48:27 -07:00
Charles Packer
cf19da6062 feat: fix streaming put_inner_thoughts_in_kwargs (#1911) 2024-10-19 21:49:45 -07:00
Matthew Zhou
c18eb466f8 feat: Add put_inner_thoughts_in_kwargs as a config setting for the LLM (#1902)
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
2024-10-17 15:54:03 -07:00
Sarah Wooders
3c547345e1 feat: add VLLMProvider (#1866)
Co-authored-by: cpacker <packercharles@gmail.com>
2024-10-11 15:58:12 -07:00
Kevin Lin
2bc97e4535 fix: fix typo (#1870)
Co-authored-by: Kevin Lin <kevinlin@Kevins-MacBook-Pro.local>
2024-10-11 15:51:23 -07:00
Matthew Zhou
c0501a743d test: add complex gemini tests (#1853)
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
2024-10-09 10:00:21 -07:00
Matthew Zhou
b83f77af22 fix: refactor Google AI Provider / helper functions and add endpoint test (#1850)
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
2024-10-08 16:55:11 -07:00
Matthew Zhou
446b8f2154 feat: Add listing llm models and embedding models for Azure endpoint (#1846)
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
2024-10-08 15:14:55 -07:00
Matthew Zhou
cffd493f75 test: add complex testing for Groq Llama 3.1 70b (#1845)
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
2024-10-08 14:22:13 -07:00
Matthew Zhou
1104438490 fix: Fix Azure provider and add complex e2e testing (#1842)
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
2024-10-07 17:59:06 -07:00
Sarah Wooders
9e4c7ad07f feat: require LLMConfig and EmbeddingConfig to be specified for agent creation + allow multiple simultaneous provider configs for server (#1814)
Co-authored-by: Shubham Naik <shubham.naik10@gmail.com>
Co-authored-by: Matthew Zhou <mattzh1314@gmail.com>
Co-authored-by: Matt Zhou <mattzhou@Matts-MacBook-Pro.local>
Co-authored-by: Shubham Naik <shub@memgpt.ai>
2024-10-04 19:35:00 -07:00
Matt Zhou
b215990b98 Edit workflows 2024-10-04 16:18:42 -07:00
cpacker
402f8bc157 fix: force inner_thoughts_in_kwargs for groq since their function calling wrapper doesn't work without it 2024-10-03 19:08:42 -07:00
cpacker
ad5b070710 fix: various fixes to get groq to work from the CLI 2024-10-03 19:03:59 -07:00
Matt Zhou
cd84d9fbdd wip add errors and refactor out into tools 2024-10-03 14:46:36 -07:00
Matt Zhou
216e69d52c Add groq flow to CLI 2024-10-03 10:04:18 -07:00
Matt Zhou
071642b74f Finish adding groq and test 2024-10-01 16:40:28 -07:00
Matt Zhou
d61b806fd5 wip 2024-10-01 16:22:34 -07:00
Matt Zhou
4035a211fb wip 2024-10-01 15:42:59 -07:00
Sarah Wooders
424cfd60b3 fix: various fixes for workflow tests (#1788) 2024-09-25 13:58:21 -07:00
Sarah Wooders
8ae1e64987 chore: migrate package name to letta (#1775)
Co-authored-by: Charles Packer <packercharles@gmail.com>
Co-authored-by: Shubham Naik <shubham.naik10@gmail.com>
Co-authored-by: Shubham Naik <shub@memgpt.ai>
2024-09-23 09:15:18 -07:00