Files

Kian Jones b8e9a80d93 merge this (#4759 )

* wait I forgot to comit locally

* cp the entire core directory and then rm the .git subdir

2025-09-17 15:47:40 -07:00

grammars

merge this (#4759 )

2025-09-17 15:47:40 -07:00

koboldcpp

merge this (#4759 )

2025-09-17 15:47:40 -07:00

llamacpp

merge this (#4759 )

2025-09-17 15:47:40 -07:00

llm_chat_completion_wrappers

merge this (#4759 )

2025-09-17 15:47:40 -07:00

lmstudio

merge this (#4759 )

2025-09-17 15:47:40 -07:00

ollama

merge this (#4759 )

2025-09-17 15:47:40 -07:00

settings

merge this (#4759 )

2025-09-17 15:47:40 -07:00

vllm

merge this (#4759 )

2025-09-17 15:47:40 -07:00

webui

merge this (#4759 )

2025-09-17 15:47:40 -07:00

__init__.py

merge this (#4759 )

2025-09-17 15:47:40 -07:00

chat_completion_proxy.py

merge this (#4759 )

2025-09-17 15:47:40 -07:00

constants.py

merge this (#4759 )

2025-09-17 15:47:40 -07:00

function_parser.py

merge this (#4759 )

2025-09-17 15:47:40 -07:00

json_parser.py

merge this (#4759 )

2025-09-17 15:47:40 -07:00

README.md

merge this (#4759 )

2025-09-17 15:47:40 -07:00

utils.py

merge this (#4759 )

2025-09-17 15:47:40 -07:00

README.md

Letta + local LLMs

See https://letta.readme.io/docs/local_llm for documentation on running Letta with custom LLM backends.