Fimeg/letta-server
1
0
Fork 0
Code Issues 4 Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
2ed31fa2adeec986037264a9ff31dc53e0b287c8
letta-server/memgpt/local_llm
History
Charles Packer 8cc1ed0f59 updated local APIs to return usage info (#585) 
* updated APIs to return usage info

* tested all endpoints
2023-12-13 21:11:20 -08:00
..
grammars
Add grammar-based sampling (for webui, llamacpp, and koboldcpp) (#293)
2023-11-04 12:02:44 -07:00
koboldcpp
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
llamacpp
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
llm_chat_completion_wrappers
AutoGen misc fixes (#603)
2023-12-10 20:52:21 -08:00
lmstudio
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
ollama
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
vllm
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
webui
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
__init__.py
basic proof of concept tested on airoboros 70b 2.1
2023-10-22 22:52:24 -07:00
chat_completion_proxy.py
updated local APIs to return usage info (#585)
2023-12-13 21:11:20 -08:00
constants.py
Add support for HuggingFace Text Embedding Inference endpoint for embeddings (#524)
2023-11-27 16:28:49 -08:00
json_parser.py
patched a bug where outputs of a regex extraction weren't getting cast back to string, causing an issue when the dict was then passed to json.dumps() (#533)
2023-11-29 12:57:05 -08:00
README.md
Update AutoGen documentation and notebook example (#540)
2023-11-30 17:45:04 -08:00
utils.py
add back dotdict for backcompat (#572)
2023-12-04 23:02:22 -08:00

README.md

MemGPT + local LLMs

See https://memgpt.readthedocs.io/en/latest/local_llm for documentation on running MemGPT with custom LLM backends.

Reference in New Issue View Git Blame Copy Permalink