Files

Charles Packer 43ed0ff714 feat: added new 'hint' wrappers that inject hints into the pre-prefix (#707 )

* added new 'hint' wrappers that inject hints into the pre-prefix

* modified basic search functions with extra input sanitization

* updated first message prefix

2023-12-25 11:29:42 -08:00

grammars

Add grammar-based sampling (for webui, llamacpp, and koboldcpp) (#293 )

2023-11-04 12:02:44 -07:00

koboldcpp

feat: Add common + custom settings files for completion endpoints (#631 )

2023-12-18 15:22:24 +04:00

llamacpp

feat: Add common + custom settings files for completion endpoints (#631 )

2023-12-18 15:22:24 +04:00

llm_chat_completion_wrappers

feat: added new 'hint' wrappers that inject hints into the pre-prefix (#707 )

2023-12-25 11:29:42 -08:00

lmstudio

feat: Add common + custom settings files for completion endpoints (#631 )

2023-12-18 15:22:24 +04:00

ollama

patch bug with raw mode (#663 )

2023-12-20 17:25:52 -08:00

settings

feat: added new 'hint' wrappers that inject hints into the pre-prefix (#707 )

2023-12-25 11:29:42 -08:00

vllm

feat: Add memgpt quickstart command (#641 )

2023-12-20 00:00:40 -08:00

webui

feat: Add common + custom settings files for completion endpoints (#631 )

2023-12-18 15:22:24 +04:00

__init__.py

basic proof of concept tested on airoboros 70b 2.1

2023-10-22 22:52:24 -07:00

chat_completion_proxy.py

feat: added new 'hint' wrappers that inject hints into the pre-prefix (#707 )

2023-12-25 11:29:42 -08:00

constants.py

feat: Add new wrapper defaults (#656 )

2023-12-21 17:05:38 +04:00

function_parser.py

feat: added basic heartbeat override heuristics (#621 )

2023-12-24 23:46:00 -08:00

json_parser.py

patched a bug where outputs of a regex extraction weren't getting cast back to string, causing an issue when the dict was then passed to json.dumps() (#533 )

2023-11-29 12:57:05 -08:00

README.md

feat: Migrate docs (#646 )

2023-12-18 20:29:24 -08:00

utils.py

feat: added new 'hint' wrappers that inject hints into the pre-prefix (#707 )

2023-12-25 11:29:42 -08:00

README.md

MemGPT + local LLMs

See https://memgpt.readme.io/docs/local_llm for documentation on running MemGPT with custom LLM backends.