From 4fca38a56d27b2bfae78ab368fbfa5daa419f63d Mon Sep 17 00:00:00 2001 From: Charles Packer Date: Wed, 8 Nov 2023 11:54:56 -0800 Subject: [PATCH] Update lmstudio.md (#382) * Update lmstudio.md * Update lmstudio.md --- docs/lmstudio.md | 9 ++++++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/docs/lmstudio.md b/docs/lmstudio.md index 95bec1ba..98f21013 100644 --- a/docs/lmstudio.md +++ b/docs/lmstudio.md @@ -1,5 +1,11 @@ ### MemGPT + LM Studio +!!! warning "Important LM Studio settings" + + Make sure that "context length" is set (inside LM Studio's "Model Configuration" panel) to the max context length of the model you're using (e.g. 8000 for Mistral 7B variants). + + If you see "Prompt Formatting" (inside LM Studio's "Server Options" panel), turn it **OFF**. Leaving it **ON** will break MemGPT. + ![image](https://github.com/cpacker/MemGPT/assets/5475622/abc8ce2d-4130-4c51-8169-83e682db625d) 1. Download [LM Studio](https://lmstudio.ai/) and the model you want to test with @@ -14,6 +20,3 @@ In your terminal where you're running MemGPT, run: export OPENAI_API_BASE=http://localhost:1234 export BACKEND_TYPE=lmstudio ``` - -* **Make sure that "context length" is set to the max context length of the model you're using (e.g. 8000 for Mistral 7B variants)** -* **If you see "Prompt Formatting" in your menu, turn it off** \ No newline at end of file