* added basic heartbeat override
* tested and working on lmstudio (patched typo + patched new bug emerging in latest lmstudio build
* added lmstudio patch to chatml wrapper
* update the system messages to be informative about the source
* updated string constants after some tuning
* added memgpt server command
* added the option to specify a port (rest default 8283, ws default 8282)
* fixed import in test
* added agent saving on shutdown
* added basic locking mechanism (assumes only one server.py is running at the same time)
* remove 'STOP' from buffer when converting to list for the non-streaming POST resposne
* removed duplicate on_event (redundant to lifespan)
* added GET agents/memory route
* added GET agent config
* added GET server config
* added PUT route for modifying agent core memory
* refactored to put server loop in separate function called via main
* init server refactor
* refactored websockets server/client code to use internal server API
* added intentional fail on test
* update workflow to try and get test to pass remotely
* refactor to put websocket code in a separate subdirectory
* added fastapi rest server
* add error handling
* modified interface return style
* disabled certain tests on remote
* added SSE response option for user_message
* fix ws interface test
* fallback for oai key
* add soft fail for test when localhost is borked
* add step_yield for all server related interfaces
* extra catch
* update toml + lock with server add-ons (add uvicorn+fastapi, move websockets to server extra)
* regen lock file
* added pytest-asyncio as an extra in dev
* add pydantic to deps
* renamed CreateConfig to CreateAgentConfig
* fixed POST request for creating agent + tested it
* updated local llm documentation
* updated cli flags to be consistent with documentation
* added preset documentation
* update test to use new arg
* update test to use new arg
* mark depricated API section
* CLI bug fixes for azure
* check azure before running
* Update README.md
* Update README.md
* bug fix with persona loading
* remove print
* make errors for cli flags more clear
* format
* fix imports
* fix imports
* add prints
* update lock
* update config fields
* cleanup config loading
* commit
* remove asserts
* refactor configure
* put into different functions
* add embedding default
* pass in config
* fixes
* allow overriding openai embedding endpoint
* black
* trying to patch tests (some circular import errors)
* update flags and docs
* patched support for local llms using endpoint and endpoint type passed via configs, not env vars
* missing files
* fix naming
* fix import
* fix two runtime errors
* patch ollama typo, move ollama model question pre-wrapper, modify question phrasing to include link to readthedocs, also have a default ollama model that has a tag included
* disable debug messages
* made error message for failed load more informative
* don't print dynamic linking function warning unless --debug
* updated tests to work with new cli workflow (disabled openai config test for now)
* added skips for tests when vars are missing
* update bad arg
* revise test to soft pass on empty string too
* don't run configure twice
* extend timeout (try to pass against nltk download)
* update defaults
* typo with endpoint type default
* patch runtime errors for when model is None
* catching another case of 'x in model' when model is None (preemptively)
* allow overrides to local llm related config params
* made model wrapper selection from a list vs raw input
* update test for select instead of input
* Fixed bug in endpoint when using local->openai selection, also added validation loop to manual endpoint entry
* updated error messages to be more informative with links to readthedocs
* add back gpt3.5-turbo
---------
Co-authored-by: cpacker <packercharles@gmail.com>
* partial
* working schema builder, tested that it matches the hand-written schemas
* correct another schema diff
* refactor
* basic working test
* refactored preset creation to use yaml files
* added docstring-parser
* add code for dynamic function linking in agent loading
* pretty schema diff printer
* support pulling from ~/.memgpt/functions/*.py
* clean
* allow looking for system prompts in ~/.memgpt/system_prompts
* create ~/.memgpt/system_prompts if it doesn't exist
* pull presets from ~/.memgpt/presets in addition to examples folder
* add support for loading agent configs that have additional keys
---------
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
* I added some json repairs that helped me with malformed messages
There are two of them: The first will remove hard line feeds that appear
in the message part because the model added those instead of escaped
line feeds. This happens a lot in my experiments and that actually fixes
them.
The second one is less tested and should handle the case that the model
answers with multiple blocks of strings in quotes or even uses unescaped
quotes. It should grab everything betwenn the message: " and the ending
curly braces, escape them and makes it propper json that way.
Disclaimer: Both function were written with the help of ChatGPT-4 (I
can't write much Python). I think the first one is quite solid but doubt
that the second one is fully working. Maybe somebody with more Python
skills than me (or with more time) has a better idea for this type of
malformed replies.
* Moved the repair output behind the debug flag and removed the "clean" one
* Added even more fixes (out of what I just encountered while testing)
It seems that cut of json can be corrected and sometimes the model is to
lazy to add not just one curly brace but two. I think it does not "cost"
a lot to try them all out. But the expeptions get massive that way :)
* black
* for the final hail mary with extract_first_json, might as well add a double end bracket instead of single
---------
Co-authored-by: cpacker <packercharles@gmail.com>
* Remove AsyncAgent and async from cli
Refactor agent.py memory.py
Refactor interface.py
Refactor main.py
Refactor openai_tools.py
Refactor cli/cli.py
stray asyncs
save
make legacy embeddings not use async
Refactor presets
Remove deleted function from import
* remove stray prints
* typo
* another stray print
* patch test
---------
Co-authored-by: cpacker <packercharles@gmail.com>
* softpass test when keys are missing
* update to use local model
* both openai and local
* typo
* fix
* Specify model inference and embedding endpoint separately (#286)
* Fix config tests (#343)
Co-authored-by: Vivian Fang <hi@vivi.sh>
* Avoid throwing error for older `~/.memgpt/config` files due to missing section `archival_storage` (#344)
* avoid error if has old config type
* Dependency management (#337)
* Divides dependencies into `pip install pymemgpt[legacy,local,postgres,dev]`.
* Update docs
* Relax verify_first_message_correctness to accept any function call (#340)
* Relax verify_first_message_correctness to accept any function call
* Also allow missing internal monologue if request_heartbeat
* Cleanup
* get instead of raw dict access
* Update `poetry.lock` (#346)
* mark depricated API section
* add readme
* add readme
* add readme
* add readme
* add readme
* add readme
* add readme
* add readme
* add readme
* CLI bug fixes for azure
* check azure before running
* Update README.md
* Update README.md
* bug fix with persona loading
* remove print
* make errors for cli flags more clear
* format
* fix imports
* fix imports
* add prints
* update lock
* Add autogen example that lets you chat with docs (#342)
* Relax verify_first_message_correctness to accept any function call
* Also allow missing internal monologue if request_heartbeat
* Cleanup
* get instead of raw dict access
* Support attach in memgpt autogen agent
* Add docs example
* Add documentation, cleanup
* add gpt-4-turbo (#349)
* add gpt-4-turbo
* add in another place
* change to 3.5 16k
* Revert relaxing verify_first_message_correctness, still add archival_memory_search as an exception (#350)
* Revert "Relax verify_first_message_correctness to accept any function call (#340)"
This reverts commit 30e911057d755f5946d7bc2ba54619b5f2e08dc3.
* add archival_memory_search as an exception for verify
* Bump version to 0.1.18 (#351)
* Remove `requirements.txt` and `requirements_local.txt` (#358)
* update requirements to match poetry
* update with extras
* remove requirements
* disable pretty exceptions (#367)
* Updated documentation for users (#365)
---------
Co-authored-by: Vivian Fang <hi@vivi.sh>
* Create pull_request_template.md (#368)
* Create pull_request_template.md
* Add pymemgpt-nightly workflow (#373)
* Add pymemgpt-nightly workflow
* change token name
* Update lmstudio.md (#382)
* Update lmstudio.md
* Update lmstudio.md
* Update lmstudio.md to show the Prompt Formatting Option (#384)
* Update lmstudio.md to show the Prompt Formatting Option
* Update lmstudio.md Update the screenshot
* Swap asset location from #384 (#385)
* Update poetry with `pg8000` and include `pgvector` in docs (#390)
* Allow overriding config location with `MEMGPT_CONFIG_PATH` (#383)
* Always default to local embeddings if not OpenAI or Azure (#387)
* Add support for larger archival memory stores (#359)
* Replace `memgpt run` flags error with warning + remove custom embedding endpoint option + add agent create time (#364)
* Update webui.md (#397)
turn emoji warning into markdown warning
* Update webui.md (#398)
* dont hard code embeddings
* formatting
* black
* add full deps
* remove changes
* update poetry
---------
Co-authored-by: Sarah Wooders <sarahwooders@gmail.com>
Co-authored-by: Vivian Fang <hi@vivi.sh>
Co-authored-by: MSZ-MGS <65172063+MSZ-MGS@users.noreply.github.com>
* I made dump showing more message and added a count (the last x)
There seem to be some changes about the implementation so that the
current dump message helper functions do not show a lot of useful info.
I changed it so that you can `dump 5` (last 5 messages) and that it will
print user readable output. This lets you get some more understanding about
what is going on.
As some messages are still not shown I also show the index (reverse) of the
printed message, so one can see what to "pop" to reach a special point
without geting into the drumpraw.
* black
* patch
---------
Co-authored-by: Charles Packer <packercharles@gmail.com>
* make tests dummy to make sure github workflow is fine
* black test
* strip circular import
* further dummy-fy the test
* use pexpect
* need y
* Update tests.yml
* Update tests.yml
* added prints
* sleep before decode print
* updated test to match legacy flow
* revising test where it fails
* comment out enter your message check for now, pexpect seems to be stuck on only setting the bootup message
* weird now it's not showing Bootup sequence complete?
* added debug
* handle none
* allow more time
* loosen string check
* add enter after commands
* modify saved compontent snippet
* add try again check
* more sendlines
* more excepts
* test passing locally
* Update tests.yml
* dont clearline
* add EOF catch that seems to only happen on github actiosn (ubuntu) but not macos
* more eof
* try flushing
* add strip_ui flag
* fix archival_memory_search and memory print output
* Don't use questionary for input if strip_ui
* Run black
* Always strip UI if TEST is set
* Add another flush
* expect Enter your message
* more debug prints
* one more shot at printing debug info
* stray fore color in stripped ui
* tests pass locally
* cleanup
---------
Co-authored-by: Vivian Fang <hi@vivi.sh>
