Charles Packer de0ccea181 vLLM support (#492) ...

* init vllm (not tested), uses POST API not openai wrapper

* add to cli config list

* working vllm endpoint

* add model configuration for vllm

---------

Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>

2023-11-21 15:16:03 -08:00

..

cli_config.py

vLLM support (#492)

2023-11-21 15:16:03 -08:00

cli_load.py

Set service context for llama index in local.py (#462)

2023-11-15 15:39:35 -08:00

cli.py

Update documentation [local LLMs, presets] (#453)

2023-11-15 01:02:57 -08:00