🛠️ Option to pre-load Composio, CrewAI, & LangChain tools

You can now auto-load tools from external libraries with the environment variable export LETTA_LOAD_DEFAULT_EXTERNAL_TOOLS=true. Then, if you run letta server, tools which do not require authorization.

export LETTA_LOAD_DEFAULT_EXTERNAL_TOOLS=true

# recommended: use with composio 
export COMPOSIO_API_KEY=...

pip install `letta[external-tools,server]`
letta server 

💭 Addition of put_inner_thoughts_in_kwargs field in LLMConfig

Some models (e.g. gpt-4o-mini) need to have inner thoughts as keyword arguments in the tool call (as opposed to having inner thoughts be in the content field). If you see your model missing inner thoughts generation, you should set put_inner_thoughts_in_kwargs=True in the LLMConfig.

🔐 Deprecation of Admin

Letta no longer requires authentication to use the Letta server and ADE. Although we still have a notion of user_id which can be passed in the BEARER_TOKEN, we expect a separate service to manage users and authentication. You will no longer need to create a user before creating an agent (agents will be assigned a default user_id).

🐞 Various Bugfixes

• Fixes to Azure embeddings endpoint

What's Changed

• refactor: make Agent.step() multi-step by @cpacker in https://github.com/cpacker/MemGPT/pull/1884
• feat: add GET route to get the breakdown of an agent's context window by @cpacker in https://github.com/cpacker/MemGPT/pull/1889
• feat: Add delete file from source endpoint by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1893
• feat: add support for agent "swarm" (multi-agent) by @sarahwooders in https://github.com/cpacker/MemGPT/pull/1878
• docs: refresh readme by @cpacker in https://github.com/cpacker/MemGPT/pull/1892
• docs: fix README by @cpacker in https://github.com/cpacker/MemGPT/pull/1894
• docs: patch readme by @cpacker in https://github.com/cpacker/MemGPT/pull/1895
• fix: Fix updating tools by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1886
• chore: fixes tool bug by @4shub in https://github.com/cpacker/MemGPT/pull/1898
• feat: Add default external tools by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1899
• feat: Add put_inner_thoughts_in_kwargs as a config setting for the LLM by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1902
• feat: prompting O1 by @kl2806 in https://github.com/cpacker/MemGPT/pull/1891
• docs: update index.md by @eltociear in https://github.com/cpacker/MemGPT/pull/1901
• docs: removed docs since they're no longer active by @cpacker in https://github.com/cpacker/MemGPT/pull/1904
• feat: Add endpoint to get full Tool objects belonging to an agent by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1906
• feat: add functions to get context window overview by @cpacker in https://github.com/cpacker/MemGPT/pull/1903
• feat: Add pagination for list tools by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1907
• chore: bump composio version for stability by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1908
• feat: add function IDs to LettaMessage function calls and response by @cpacker in https://github.com/cpacker/MemGPT/pull/1909
• feat: fix streaming put_inner_thoughts_in_kwargs by @cpacker in https://github.com/cpacker/MemGPT/pull/1911
• revert: Revert "feat: fix streaming put_inner_thoughts_in_kwargs" by @cpacker in https://github.com/cpacker/MemGPT/pull/1912
• feat: fix streaming put_inner_thoughts_in_kwargs by @cpacker in https://github.com/cpacker/MemGPT/pull/1913
• fix: Add embedding tests to azure by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1920
• feat: Add ORM for organization model by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1914
• chore: remove the admin client and tests by @sarahwooders in https://github.com/cpacker/MemGPT/pull/1923
• fix: fix bug triggered by using ada embeddings by @cpacker in https://github.com/cpacker/MemGPT/pull/1915
• feat: Add ORM for user model by @mattzh72 in https://github.com/cpacker/MemGPT/pull/1924
• fix: fix core memory heartbeat issue by @sarahwooders in https://github.com/cpacker/MemGPT/pull/1929
• chore: bump to version 0.5.1 by @sarahwooders in https://github.com/cpacker/MemGPT/pull/1922

Full Changelog: https://github.com/cpacker/MemGPT/compare/0.5.0...0.5.1