2 Commits

Author	SHA1	Message	Date
Charles Packer	7f950b05e8	Patch local LLMs with context_window (#416) ... * patch * patch ollama * patch lmstudio * patch kobold	2023-11-10 12:06:41 -08:00
Charles Packer	e90c00ad63	Add grammar-based sampling (for webui, llamacpp, and koboldcpp) (#293) ... * add llamacpp server support * use gbnf loader * cleanup and warning about grammar when not using llama.cpp * added memgpt-specific grammar file * add grammar support to webui api calls * black * typo * add koboldcpp support * no more defaulting to webui, should error out instead * fix grammar * patch kobold (testing, now working) + cleanup log messages Co-Authored-By: Drake-AI <drake-ai@users.noreply.github.com>	2023-11-04 12:02:44 -07:00