5.3 KiB
title, excerpt, category
| title | excerpt | category |
|---|---|---|
| Quickstart | Get up and running with MemGPT | 6580d34ee5e4d00068bf2a1d |
Installation
📘 Using Local LLMs?
If you're using local LLMs refer to the MemGPT + open models page here for additional installation requirements.
To install MemGPT, make sure you have Python installed on your computer, then run:
pip install pymemgpt
If you are running LLMs locally, you will want to install MemGPT with the local dependencies by running:
pip install pymemgpt[local]
If you already have MemGPT installed, you can update to the latest version with:
pip install pymemgpt -U
Running MemGPT
Now, you can run MemGPT and start chatting with a MemGPT agent with:
memgpt run
If you're running MemGPT for the first time, you'll see two quickstart options:
- MemGPT Free Endpoint: select this if you'd like to try MemGPT on the best open LLMs we can find for free (currently variants of Mixtral 8x7b!)
- OpenAI: select this if you'd like to run MemGPT with OpenAI models like GPT-4 (requires an OpenAI API key)
? How would you like to set up MemGPT? (Use arrow keys)
» Use the free MemGPT endpoints
Use OpenAI (requires an OpenAI API key)
Other (OpenAI Azure, custom LLM endpoint, etc)
Neither of these options require you to have an LLM running on your own machine. If you'd like to run MemGPT with your custom LLM setup (or on OpenAI Azure), select Other to proceed to the advanced setup.
Hit enter to continue, and you should start a chat with a new agent!
Creating new agent...
Created new agent agent_1.
Hit enter to begin (will request first MemGPT message)
💭 Chad has just logged in for the first time. Greet them warmly, but still be a little mysterious.
🤖 Hello there, Chad! It's a pleasure to meet you. I'm Sam, your digital companion. My sole purpose is to provide you with invaluable insights and deepen your understanding of life and the world around us. Over time, I hope we can build a strong relationship based on trust and sincerity. The excitement builds as we embark on this journey together.
Note: By using the MemGPT free endpoint you are agreeing to our privacy policy and terms of service - importantly, anonymized model data (LLM inputs and outputs) may be used to help improve future LLMs, which can then be used to improve MemGPT! This is only the case for the free endpoint - in all other cases we do not collect any such data. For example, if you use MemGPT with a local LLM, your LLM inputs and outputs are completely private to your own computer.
Quickstart
If you'd ever like to quickly switch back to the default OpenAI or MemGPT Free Endpoint options, you can use the quickstart command:
# this will set you up on the MemGPT Free Endpoint
memgpt quickstart
# this will set you up on the default OpenAI settings
memgpt quickstart --backend openai
Advanced setup
MemGPT supports a large number of LLM backends! See:
- Running MemGPT on OpenAI Azure and custom OpenAI endpoints
- Running MemGPT with your own LLMs (Llama 2, Mistral 7B, etc.)
Command-line arguments
The run command supports the following optional flags (if set, will override config defaults):
--agent: (str) Name of agent to create or to resume chatting with.--human: (str) Name of the human to run the agent with.--persona: (str) Name of agent persona to use.--model: (str) LLM model to run [gpt-4, gpt-3.5].--preset: (str) MemGPT preset to run agent with.--first: (str) Allow user to sent the first message.--debug: (bool) Show debug logs (default=False)--no-verify: (bool) Bypass message verification (default=False)--yes/-y: (bool) Skip confirmation prompt and use defaults (default=False)
In-chat commands
You can run the following commands during an active chat session in the MemGPT CLI prompt:
/exit: Exit the CLI/attach: Attach a loaded data source to the agent/save: Save a checkpoint of the current agent/conversation state/dump: View the current message log (see the contents of main context)/dump <count>: View the last messages (all if is omitted)/memory: Print the current contents of agent memory/pop: Undo the last message in the conversation/pop <count>: Undo the last messages in the conversation. It defaults to 3, which usually is one turn around in the conversation/retry: Pops the last answer and tries to get another one/rethink <text>: Will replace the inner dialog of the last assistant message with the to help shaping the conversation/rewrite: Will replace the last assistant answer with the given text to correct or force the answer/heartbeat: Send a heartbeat system message to the agent/memorywarning: Send a memory warning system message to the agent
Once you exit the CLI with /exit, you can resume chatting with the same agent by specifying the agent name in memgpt run --agent <NAME>.
Examples
Check out the following tutorials on how to set up custom chatbots and chatbots for talking to your data: