Commit Graph

280 Commits

Author SHA1 Message Date
Matthew Zhou
0103ea6fcf feat: Asyncify model listing for Gemini (#2284) 2025-05-20 16:00:20 -07:00
Matthew Zhou
b0f38cd2b1 feat: Asyncify anthropic model listing (#2283) 2025-05-20 15:59:42 -07:00
Matthew Zhou
e4fda7d6c7 feat: Asyncify openai model listing (#2281) 2025-05-20 15:24:00 -07:00
Matthew Zhou
068f27d83d feat: Add tavily search builtin tool (#2257) 2025-05-19 16:38:11 -07:00
cthomas
2dde1f34ef feat: configure retries on anthropic client (#2254) 2025-05-19 16:19:27 -07:00
cthomas
5df7bd5af6 feat: protect against anthropic nested tool args (#2250) 2025-05-19 16:01:59 -07:00
Andy Li
0a54b998a8 feat: track llm provider traces and tracking steps in async agent loop (#2219) 2025-05-19 15:50:56 -07:00
Sarah Wooders
ed2ddad6a5 chore: add gemini + vertex to new agent loop (#2230) 2025-05-17 21:47:42 -07:00
Sarah Wooders
f076964bd1 feat: support together in new agent loop and add tests (#2231) 2025-05-17 19:17:08 -07:00
cthomas
856d98d33d feat: add informative error for max tokens exceeded (#2223) 2025-05-16 14:02:11 -07:00
Kevin Lin
d133ca248f fix: patch lmstudio qwen (#2155) 2025-05-13 14:42:00 -07:00
cthomas
d67c425532 test: add additional new agent messaging tests (#2120) 2025-05-12 15:58:52 -07:00
Kevin Lin
6a33859224 fix: use auto function calling for together models (#2097) 2025-05-09 17:46:35 -07:00
Andy Li
bf1874dbc9 fix: summarization includes tool call message before truncation (#2084)
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
2025-05-09 15:01:12 -07:00
Charles Packer
8bb194541e fix: make togetherai nebius xai etc usable via the openaiprovider (#1981)
Co-authored-by: Kevin Lin <klin5061@gmail.com>
Co-authored-by: Kevin Lin <kl2806@columbia.edu>
2025-05-09 10:50:55 -07:00
cthomas
5dbaa0e5e5 fix: missing json import (#2073) 2025-05-08 13:33:39 -07:00
cthomas
93d702141d fix: inner thoughts constant (#2070) 2025-05-07 21:33:34 -07:00
jnjpng
05e1623389 feat: add endpoint to test connection to llm provider (#2032)
Co-authored-by: Jin Peng <jinjpeng@Jins-MacBook-Pro.local>
2025-05-07 16:26:55 -07:00
cthomas
3a2a7e4001 fix: vertex imports (#2063) 2025-05-07 15:44:44 -07:00
Andy Li
abd3fb3204 chore: enable vertex experimental (#2053)
Co-authored-by: Caren Thomas <carenthomas@gmail.com>
2025-05-07 14:52:26 -07:00
cthomas
f5b224602e feat: add vertex to new agent loop (#2054) 2025-05-07 14:03:07 -07:00
cthomas
d8151d76e2 feat: add provider_category field to distinguish byok (#2038) 2025-05-06 17:31:36 -07:00
jnjpng
7956da93a8 fix: skip warning logs for valid event types for anthropic (#2014)
Co-authored-by: Jin Peng <jinjpeng@Jins-MacBook-Pro.local>
2025-05-05 17:07:38 -07:00
Sarah Wooders
80db705db7 chore: enable flash and fix vertex integration (#2003) 2025-05-05 13:47:28 -07:00
Charles Packer
77f9e2d127 fix: patch o1 support (#1978) 2025-05-02 14:54:25 -07:00
cthomas
65280d6f3c feat: add gemini to byok (#1993) 2025-05-02 14:01:23 -07:00
Andy Li
93cc510839 fix: handle malformed function calls in vertex (#1987) 2025-05-02 11:45:41 -07:00
cthomas
9280d85ba4 feat: always add user id to openai requests (#1969) 2025-04-30 23:23:01 -07:00
cthomas
25c188689a feat: byok 2.0 (#1963) 2025-04-30 21:26:50 -07:00
Matthew Zhou
09cbb00d80 feat: Add thinking budget for vertex gemini (#1960) 2025-04-30 18:37:42 -07:00
cthomas
5187e79a43 feat: use new model-proxy in production (#1908) 2025-04-30 15:20:54 -07:00
Sarah Wooders
c6650de5fc fix: trigger gemini retry with ValueError (#1918) 2025-04-28 18:47:29 -07:00
cthomas
dc1ecdc902 fix: put inner thoughts in kwargs for anthropic (#1911) 2025-04-28 16:37:29 -07:00
cthomas
83157c1949 feat: add letta-free endpoint constant (#1907) 2025-04-27 12:57:06 -07:00
Charles Packer
1568f6b5b4 fix: patch weird OSS / cloud drift by copying in OSS into cloud (#1904) 2025-04-26 23:21:00 -07:00
cthomas
7605675f23 feat: add llm config per request (#1866) 2025-04-23 16:37:05 -07:00
cthomas
167c6a1d2e fix: pydantic serializer warning datetime -> int (#1701) 2025-04-23 14:53:58 -07:00
Charles Packer
e1fa7f0b40 fix: patch o-series (#1699) 2025-04-23 13:41:34 -07:00
cthomas
b0faff1ae9 fix: tool_name unreachable bug (#1803) 2025-04-19 16:29:14 -07:00
Kevin Lin
7e56c7dd3b fix: llm_config.put_inner_thoughts_in_kwargs = True (#1718) 2025-04-15 14:47:54 -07:00
Matthew Zhou
cead849f19 feat: Implement resume step after request in new batch agent loop (#1676) 2025-04-15 13:56:22 -07:00
Charles Packer
1c0e1bffde fix: patch grok-3 and grok-3-fast (skip reasoners for now) (#1703) 2025-04-14 12:55:20 -07:00
Kevin Lin
4f3d05e6a6 feat: add reasoning effort in LLMConfig (#1697)
Co-authored-by: cpacker <packercharles@gmail.com>
2025-04-13 17:44:10 -07:00
Sarah Wooders
32f08883ca fix: force tool_choice to be auto for claude-3.7-sonnet (#1694) 2025-04-12 16:39:36 -07:00
Sarah Wooders
1dbf6cd4e5 feat: translate system to developer or o-series models (#1692)
Co-authored-by: cpacker <packercharles@gmail.com>
2025-04-11 21:59:48 -07:00
Charles Packer
79ffadaee1 fix: patch key error (unclear if we should fatally error here, or jus… (#1690) 2025-04-11 21:24:53 -07:00
Kevin Lin
14bf712cbe fix: patch o1 and o3-mini (#1657) 2025-04-10 13:50:38 -07:00
Matthew Zhou
68fbcf33d8 feat: Finish step_until_request in new batch agent loop (#1656) 2025-04-10 10:19:06 -07:00
Charles Packer
ee8e095b69 fix: patch gemini 2.5 pro (#1643)
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
2025-04-09 18:35:53 -07:00
Matthew Zhou
4536800b3d fix: Fix build request data for OpenAI (#1654) 2025-04-09 16:31:20 -07:00