Fimeg/letta-server
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

added vLLM doc page since we support it (#545)

Browse Source 
* added vLLM doc page since we support it

* capitalization

* updated documentation
This commit is contained in:
Charles Packer
2023-12-01 11:27:24 -08:00
committed by GitHub
parent a2bf5a2b58
commit 5d3f2f1a12
6 changed files with 33 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/koboldcpp.md
View File

@@ -17,7 +17,7 @@ In your terminal where you're running MemGPT, run `memgpt configure` to set the
...
```
If you have an existing agent that you want to move to the web UI backend, add extra flags to `memgpt run`:
If you have an existing agent that you want to move to the koboldcpp backend, add extra flags to `memgpt run`:
```sh
memgpt run --agent your_agent --model-endpoint-type koboldcpp --model-endpoint http://localhost:5001
```