Commit Graph

6949 Commits

Author SHA1 Message Date
Owen Easter
2e6c68215b Update README.md (#760) 2024-01-01 19:07:29 -08:00
SaneGaming
761ef19b0c Include steps for Local LLMs (#749)
Added install instructions if running LLMs locally.
2023-12-31 22:52:18 -08:00
Jim Lloyd
7ffb3c0149 feat: enum choices for list command argument (issue #732) (#746)
* enum choices for list command argument

* fixup! enum choices for list command argument
2023-12-31 13:27:10 -08:00
Charles Packer
b487366f21 Merge branch 'main' into cherry-pick-storage-refactor 2023-12-30 21:38:58 -08:00
BabellDev
b2e9a24671 feat: Add MemGPT "Python Client" (#713)
* First commit of memgpt client and some messy test code

* rolled back unnecessary changes to abstract interface; switched client to always use Queueing Interface

* Added missing interface clear() in run_command;  added convenience method for checking if an agent exists, used that in create_agent

* Formatting fixes

* Fixed incorrect naming of get_agent_memory in rest server

* Removed erroneous clear from client save method;  Replaced print statements with appropriate logger calls in server

* Updated readme with client usage instructions

* added tests for Client

* make printing to terminal togglable on queininginterface (should probably refactor this to a logger)

* turn off printing to stdout via interface by default

* allow importing the python client in a similar fashion to openai-python (see https://github.com/openai/openai-python)

* Allowed quickstart on init of client;  updated readme and test_client accordingly

* oops, fixed name of openai_api_key config key

* Fixed small typo

* Fixed broken test by adding memgpt hosted model details to agent config

* silence llamaindex 'LLM is explicitly disabled. Using MockLLM.' on server

* default to openai if user's memgpt directory is empty (first time)

* correct type hint

* updated section on client in readme

* added comment about how MemGPT config != Agent config

* patch unrelated test

* update wording on readme

* patch another unrelated test

* added python client to readme docs

* Changed 'user' to 'human' in example;  Defaulted AgentConfig.model to 'None';  Fixed issue in create_agent (accounting for dict config);  matched test code to example

* Fixed advanced example

* patch test

* patch

---------

Co-authored-by: cpacker <packercharles@gmail.com>
2023-12-30 12:43:46 -08:00
Charles Packer
0b9fdcf46c fix: added new json test case + added fix for it (also refactored clean json func) (#739) 2023-12-28 23:01:45 -08:00
Charles Packer
653693c398 feat: chatml-noforce-roles wrapper + cli fix (#738)
* added new wrapper option to turn system style messages into system role messages

* added multirole wrapper

* unrelated issue with cli print due to previous PR (not showing core memory edits)
2023-12-28 22:12:52 -08:00
Charles Packer
53500d4688 add cleanup code (#726) 2023-12-28 22:00:24 -08:00
Charles Packer
415a39cb19 docs: synced reference docs to git (#737) 2023-12-28 20:51:45 -08:00
Charles Packer
723da684b1 don't insert request heartbeat into pause heartbeat (#727) 2023-12-28 12:11:31 -08:00
Vlad Cuciureanu
5358c839ee fix: Typo in info log message and docs (#730) 2023-12-28 12:11:09 -08:00
Charles Packer
e2e2a5c78c updated CLI interface to properly print searches on archival memory + recall memory (#731) 2023-12-28 12:06:20 -08:00
Charles Packer
b5fd0d5a17 patch bug on TEI embedding lookup (#724) 2023-12-27 22:10:15 -08:00
Charles Packer
02a8a42cb0 fix: patch TEI error in load (#725)
* patch TEI error in load (now get different error)

* more hiding of MOCKLLM

* fix embedding dim

* refactored bandaid patches into custom embedding class return object patch
2023-12-27 22:09:29 -08:00
Sarah Wooders
5f554d305b Increase workflow test timeout time + add test prints 2023-12-27 15:42:11 +04:00
Sarah Wooders
b8a82b9569 Use MutableJSON instead of JSONB type for metadata 2023-12-27 15:10:22 +04:00
Sarah Wooders
ba8efb03e8 Add sqlalchemy package 2023-12-27 14:58:57 +04:00
Sarah Wooders
515d9d0f62 Fix bug with chroma vector query 2023-12-27 14:40:11 +04:00
Sarah Wooders
b598f3e2d4 Re-run black formatter on resolved conflicts 2023-12-27 13:50:24 +04:00
Sarah Wooders
77e72d18da Merge branch 'main' into cherry-pick-storage-refactor 2023-12-27 13:47:27 +04:00
Sarah Wooders
545fc6cf79 ci: Run tests using postgres docker container (#715)
* use postgres docker for tests

* checkout repo

* add checkout

* remove secrets
2023-12-27 13:44:33 +04:00
Charles Packer
42e2a301eb fix: increase the func return char limit (#714)
* increase the funct return limit

* disable truncation for base search functions

* added stdout suppression to remove MockLLM warning
2023-12-27 01:33:30 -08:00
Sarah Wooders
ac89413afa ci: Run tests using postgres docker container (#715)
* use postgres docker for tests

* checkout repo

* add checkout

* remove secrets
2023-12-27 01:29:10 -08:00
Sarah Wooders
ba550fbb07 Update memgpt configure to reflect current storage connector options 2023-12-26 19:28:13 +04:00
Sarah Wooders
5b991988f6 Deprecate list_loaded_data for listing sources, and use metadata DB instead 2023-12-26 18:47:16 +04:00
Sarah Wooders
a6dd3ab4d8 Support data source deletion with 'memgpt delete source <name>' 2023-12-26 18:28:53 +04:00
Max Blackmer
c43acc3ece [cpacker#319] fixed moved function call. 2023-12-26 09:03:35 -05:00
Sarah Wooders
3f8b9063a1 Run black formatter 2023-12-26 17:53:57 +04:00
Max Blackmer
5733f0418d [cpacker#319] Refactor memgptlog.py to log.py and move a function to log.py 2023-12-26 08:52:24 -05:00
Sarah Wooders
0c2bf05406 Bugfixes for get_all function and code cleanup to match main 2023-12-26 17:50:49 +04:00
Sarah Wooders
11096b20a4 Set get_all limit to None by default and add postgres to archival memory tests 2023-12-26 17:07:54 +04:00
Sarah Wooders
2a4df2263f Add skeleton code for lance integration 2023-12-26 17:07:41 +04:00
Sarah Wooders
d4ddf549e3 Support attaching data sources to agents for storage refactor 2023-12-26 17:07:28 +04:00
Sarah Wooders
7a14e2020a Support 'memgpt list sources' for storage refactor 2023-12-26 17:07:18 +04:00
Sarah Wooders
b64f3aca4b Support metadata table via storage connectors for data sources 2023-12-26 17:06:58 +04:00
Sarah Wooders
deb7f3c1e1 Enable loading local agents with refactored recall memory + update MemGPTConfig to default to sqlite + chroma 2023-12-26 17:06:56 +04:00
Sarah Wooders
5002b8e1dd Add SQLite integration for recall memory 2023-12-26 17:06:56 +04:00
Sarah Wooders
e2b29d8995 Bugfixes and test updates for passing tests for both postgres and chroma 2023-12-26 17:06:18 +04:00
Sarah Wooders
b4b05bd75d Update storage tests and chroma for passing tests 2023-12-26 17:06:00 +04:00
Sarah Wooders
0e935d3ebd Add more compehensive tests, make row ids be strings (not integers) 2023-12-26 17:05:58 +04:00
Sarah Wooders
453a7c0c3e Refactor chroma integration 2023-12-26 17:05:41 +04:00
Sarah Wooders
8a3681297a Cleanup agent function linking 2023-12-26 17:05:26 +04:00
Sarah Wooders
223e196da8 Support recall and archival memory for postgres
working test
2023-12-26 17:05:24 +04:00
Sarah Wooders
408df89c9c Add in memory storage connector implementation for refactored storage 2023-12-26 17:05:24 +04:00
Sarah Wooders
d041455375 Add data_types.py file for standard data types 2023-12-26 17:05:12 +04:00
Sarah Wooders
234a444090 Define refactored storage table types (archival, recall, documents,
users, agents)
2023-12-26 17:04:11 +04:00
Max Blackmer, CSM
ebbd176e71 Merge branch 'main' into feature/global-logging 2023-12-25 14:53:19 -05:00
Charles Packer
6ab500b3b6 bump version 0.2.10 (#699) 2023-12-25 11:45:53 -08:00
Charles Packer
43ed0ff714 feat: added new 'hint' wrappers that inject hints into the pre-prefix (#707)
* added new 'hint' wrappers that inject hints into the pre-prefix

* modified basic search functions with extra input sanitization

* updated first message prefix
2023-12-25 11:29:42 -08:00
Charles Packer
3ec8bb1465 fix: misc fixes (#700)
* add folder generation

* disable default temp until more testing is done

* apply embedding payload patch to search, add input checking for better runtime error messages

* streamlined memory pressure warning now that heartbeats get forced
2023-12-25 01:29:13 -08:00