Files
letta-server/tests/configs/llm_model_configs/vllm.json
Kian Jones b8e9a80d93 merge this (#4759)
* wait I forgot to comit locally

* cp the entire core directory and then rm the .git subdir
2025-09-17 15:47:40 -07:00

9 lines
212 B
JSON

{
"context_window": 8192,
"model_endpoint_type": "openai",
"provider_name": "vllm",
"model_endpoint": "http://127.0.0.1:8000/v1",
"model": "Qwen/Qwen3-32B-AWQ",
"put_inner_thoughts_in_kwargs": true
}