Fimeg/letta-server
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Charles Packer
2023-10-22 23:13:49 -07:00
committed by GitHub
parent e4add84bbe
commit c8b89e25d0
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
memgpt/local_llm/README.md
View File

@@ -1,4 +1,4 @@
## tl;dr - how to connect MemGPT to non-OpenAI LLMs
## How to connect MemGPT to non-OpenAI LLMs
**If you have a hosted ChatCompletion-compatible endpoint that works with function calling**:
- simply set `OPENAI_API_BASE` to the IP+port of your endpoint:
@@ -7,7 +7,7 @@
export OPENAI_API_BASE=...
```
Note: for this to work, the endpoint MUST support function calls. As of 10/22/2023, most ChatCompletion endpoints do NOT support function calls, so if you want to play with MemGPT and open models, follow the instructions below.
Note: for this to work, the endpoint **MUST** support function calls. As of 10/22/2023, most ChatCompletion endpoints do **NOT** support function calls, so if you want to play with MemGPT and open models, you probably need to follow the instructions below.
## Integrating a function-call finetuned LLM with MemGPT