Commit Graph

85 Commits

Author SHA1 Message Date
cpacker
c236ba5bdb added success and fail messages to memgpt source delete 2024-01-02 13:39:26 -08:00
cpacker
e02a75d40c clean up the error messages stemming from a badly configured endpoint (bad url, url is none, etc) 2024-01-02 13:28:06 -08:00
cpacker
3de3fb8315 don't allow bad endpoint addresses during memgpt configure 2024-01-02 13:27:19 -08:00
cpacker
b022b6e172 Merge branch 'main' into cherry-pick-storage-refactor 2024-01-02 12:21:56 -08:00
Jim Lloyd
7ffb3c0149 feat: enum choices for list command argument (issue #732) (#746)
* enum choices for list command argument

* fixup! enum choices for list command argument
2023-12-31 13:27:10 -08:00
Charles Packer
b487366f21 Merge branch 'main' into cherry-pick-storage-refactor 2023-12-30 21:38:58 -08:00
BabellDev
b2e9a24671 feat: Add MemGPT "Python Client" (#713)
* First commit of memgpt client and some messy test code

* rolled back unnecessary changes to abstract interface; switched client to always use Queueing Interface

* Added missing interface clear() in run_command;  added convenience method for checking if an agent exists, used that in create_agent

* Formatting fixes

* Fixed incorrect naming of get_agent_memory in rest server

* Removed erroneous clear from client save method;  Replaced print statements with appropriate logger calls in server

* Updated readme with client usage instructions

* added tests for Client

* make printing to terminal togglable on queininginterface (should probably refactor this to a logger)

* turn off printing to stdout via interface by default

* allow importing the python client in a similar fashion to openai-python (see https://github.com/openai/openai-python)

* Allowed quickstart on init of client;  updated readme and test_client accordingly

* oops, fixed name of openai_api_key config key

* Fixed small typo

* Fixed broken test by adding memgpt hosted model details to agent config

* silence llamaindex 'LLM is explicitly disabled. Using MockLLM.' on server

* default to openai if user's memgpt directory is empty (first time)

* correct type hint

* updated section on client in readme

* added comment about how MemGPT config != Agent config

* patch unrelated test

* update wording on readme

* patch another unrelated test

* added python client to readme docs

* Changed 'user' to 'human' in example;  Defaulted AgentConfig.model to 'None';  Fixed issue in create_agent (accounting for dict config);  matched test code to example

* Fixed advanced example

* patch test

* patch

---------

Co-authored-by: cpacker <packercharles@gmail.com>
2023-12-30 12:43:46 -08:00
Charles Packer
53500d4688 add cleanup code (#726) 2023-12-28 22:00:24 -08:00
Charles Packer
02a8a42cb0 fix: patch TEI error in load (#725)
* patch TEI error in load (now get different error)

* more hiding of MOCKLLM

* fix embedding dim

* refactored bandaid patches into custom embedding class return object patch
2023-12-27 22:09:29 -08:00
Sarah Wooders
b598f3e2d4 Re-run black formatter on resolved conflicts 2023-12-27 13:50:24 +04:00
Sarah Wooders
77e72d18da Merge branch 'main' into cherry-pick-storage-refactor 2023-12-27 13:47:27 +04:00
Charles Packer
42e2a301eb fix: increase the func return char limit (#714)
* increase the funct return limit

* disable truncation for base search functions

* added stdout suppression to remove MockLLM warning
2023-12-27 01:33:30 -08:00
Sarah Wooders
ba550fbb07 Update memgpt configure to reflect current storage connector options 2023-12-26 19:28:13 +04:00
Sarah Wooders
5b991988f6 Deprecate list_loaded_data for listing sources, and use metadata DB instead 2023-12-26 18:47:16 +04:00
Sarah Wooders
a6dd3ab4d8 Support data source deletion with 'memgpt delete source <name>' 2023-12-26 18:28:53 +04:00
Sarah Wooders
11096b20a4 Set get_all limit to None by default and add postgres to archival memory tests 2023-12-26 17:07:54 +04:00
Sarah Wooders
d4ddf549e3 Support attaching data sources to agents for storage refactor 2023-12-26 17:07:28 +04:00
Sarah Wooders
7a14e2020a Support 'memgpt list sources' for storage refactor 2023-12-26 17:07:18 +04:00
Sarah Wooders
b64f3aca4b Support metadata table via storage connectors for data sources 2023-12-26 17:06:58 +04:00
Sarah Wooders
deb7f3c1e1 Enable loading local agents with refactored recall memory + update MemGPTConfig to default to sqlite + chroma 2023-12-26 17:06:56 +04:00
Sarah Wooders
0e935d3ebd Add more compehensive tests, make row ids be strings (not integers) 2023-12-26 17:05:58 +04:00
Sarah Wooders
453a7c0c3e Refactor chroma integration 2023-12-26 17:05:41 +04:00
Sarah Wooders
223e196da8 Support recall and archival memory for postgres
working test
2023-12-26 17:05:24 +04:00
Sarah Wooders
234a444090 Define refactored storage table types (archival, recall, documents,
users, agents)
2023-12-26 17:04:11 +04:00
Charles Packer
6394ca73ef Added length checking to the persona/human loader functions, also updated the CLI error dump to look prettier (eg on over length errors) (#695) 2023-12-24 23:05:13 -08:00
Charles Packer
1c983e7a53 fix: allow edge case of quickstart before run on first install (#684) 2023-12-23 12:06:19 -08:00
Charles Packer
3482a196d6 feat: improve CLI appearance (#687)
* prettified standard cli output

* also suppress stdout for agent loading

* better spacing

* added emoji to existing agent load
2023-12-23 11:39:51 -08:00
Charles Packer
0b765ee95b fix: Patch quickstart via run on empty dir (#682)
* fixed bug where memgpt run's quickstart invocation was pulling from latest instead of local

* patched missing config dir creation step
2023-12-22 11:17:47 -08:00
Charles Packer
7053d1ff8e moved configs folder inside memgpt so that it gets included with the package, updated paths (#680) 2023-12-22 10:34:04 -08:00
Charles Packer
ce0c3c92d1 feat: further simplify setup flow (#673)
* made quickstart to openai or memgpt the default option when the user doesn't have a config set

* modified formatting + message styles

* revised quickstart guides in docs to talk about quickstart command

* make message consistent

---------

Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
2023-12-22 13:21:25 +04:00
Charles Packer
776a30e7dd feat: pull model list for openai-compatible endpoints (#630)
* allow entering custom model name when using openai/azure

* pull models from endpoint

* added/tested vllm and azure

* no print

* make red

* make the endpoint question give you an opportunity to enter your openai api key again in case you made a mitake / want to swap it out

* add cascading workflow for openai+azure model listings

* patched bug w/ azure listing
2023-12-21 23:27:48 -08:00
Charles Packer
1c38899b2e fix: CLI conveniences (add-on to #674) (#675)
* for openai, check for key and if missing allow user to pass it, for azure, throw error if the key isn't present

* correct prior checking of azure to be more strict, added similar checks at the embedding endpoint config stage

* forgot to override value in config before saving

* clean up the valuerrors from missing keys so that no stacktrace gets printed, make success text green to match others
2023-12-21 21:35:19 -08:00
Matheus
f22923d716 fix: Throw "env vars not set" early + enhance attach for KeyboardInterrupt (#669) (#674) 2023-12-21 20:47:34 -08:00
Charles Packer
46f686dfde fix: Patch openai error message + openai quickstart (#665)
* removed risky prints

* cleanup

* fix bug with openai quickstart, add extra visual indicators that quickstart worked

* changed message
2023-12-21 00:17:37 -08:00
Charles Packer
f532ffc41f feat: Add memgpt quickstart command (#641)
* Revert "Revert "nonfunctional 404 quickstart command w/ some other typo corrections""

This reverts commit 5dbdf31f1ce939843ff97e649554d8bc0556a834.

* Revert "Revert "added example config file""

This reverts commit 72a58f6de31f3ff71847bbaf083a91182469f9af.

* tested and working

* added and tested openai quickstart, added fallback if internet 404's to pull from local copy

* typo

* updated openai key input message to include html link

* renamed --type to --backend, added --latest flag which fetches from online default is to pull from local file

* fixed links
2023-12-20 00:00:40 -08:00
Charles Packer
f8b99b562f feat: Migrate docs (#646)
* updated docs for readme

* Update index.md

* Update index.md

* added header

* broken link

* sync heading sizes

* fix various broken rel links

* Update index.md

* added webp

* Update index.md

* strip mkdocs/rtk files

* replaced readthedocs references with readme
2023-12-18 20:29:24 -08:00
cpacker
7f2edd8dd7 Revert "nonfunctional 404 quickstart command w/ some other typo corrections"
This reverts commit 22119cfb037c7d9379653006eafa03042eafcbe8.
2023-12-18 00:48:47 -08:00
cpacker
9c8ed92ad7 nonfunctional 404 quickstart command w/ some other typo corrections 2023-12-18 00:45:02 -08:00
Charles Packer
569bc7da31 feat: added memgpt folder command (#632)
* added memgpt folder command

* comments
2023-12-17 10:54:17 -08:00
Charles Packer
070c0123c6 migrate to using completions endpoint by default (#628)
* migrate to using completions endpoint by default

* added note about version to docs
2023-12-15 12:29:52 -08:00
Charles Packer
d51c61e91c allow passing custom host to uvicorn (#618) 2023-12-14 13:01:33 -08:00
Charles Packer
2048ba179b added memgpt server command (#611)
* added memgpt server command

* added the option to specify a port (rest default 8283, ws default 8282)

* fixed import in test

* added agent saving on shutdown

* added basic locking mechanism (assumes only one server.py is running at the same time)

* remove 'STOP' from buffer when converting to list for the non-streaming POST resposne

* removed duplicate on_event (redundant to lifespan)

* added GET agents/memory route

* added GET agent config

* added GET server config

* added PUT route for modifying agent core memory

* refactored to put server loop in separate function called via main
2023-12-13 00:41:40 -08:00
Charles Packer
b2e88da277 Patch azure embeddings + handle azure deployments properly (#594)
* Fix bug where embeddings endpoint was getting set to deployment, upgraded pinned llama-index to use new version that has azure endpoint

* updated documentation

* added memgpt example for openai

* change wording to match configure
2023-12-08 16:31:43 -08:00
Sarah Wooders
6a155dfc90 Chroma storage integration (#285) 2023-12-05 17:49:00 -08:00
Charles Packer
df999de4c1 use a consistent warning prefix across codebase (#569) 2023-12-04 11:38:51 -08:00
Charles Packer
b741b601fb Update AutoGen documentation and notebook example (#540)
* Update AutoGen documentation

* Update webui.md

* Update webui.md

* Update lmstudio.md

* Update lmstudio.md

* Update mkdocs.yml

* Update README.md

* Update README.md

* Update README.md

* Update autogen.md

* Update local_llm.md

* Update local_llm.md

* Update autogen.md

* Update autogen.md

* Update autogen.md

* refreshed the autogen examples + notebook (notebook is untested)

* unrelated patch of typo I noticed

* poetry remove pyautogen, then manually removed autogen extra in .toml

* add pdf dependency

---------

Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
2023-11-30 17:45:04 -08:00
Sarah Wooders
2857ae1c81 Remove usage of BACKEND_TYPE (#539) 2023-11-30 14:18:25 -08:00
Sarah Wooders
2d23370930 Removing dead code + legacy commands (#536) 2023-11-30 13:37:11 -08:00
Charles Packer
5e7676e133 Remove openai package and migrate to requests (#534) 2023-11-30 13:00:13 -08:00
Sarah Wooders
ed356dd82c Add support for HuggingFace Text Embedding Inference endpoint for embeddings (#524) 2023-11-27 16:28:49 -08:00