Highlights

• New feature from research: AgentOptimizer
  • Blog
  • Notebook
• New feature in code execution: Support user defined functions in local CLI executor - similar functionality to the "skills" in AutoGen Studio.
• New agent capability: Vision Capability for ConversableAgents allows them to "see" images.
• New IOStream protocol and support for web sockets!
• New custom model: Mistral AI API with native tool call support. conversational chess game powered by mistral
• New benchmarking tool: WebArena. Run agents in the WebArena benchmark.
• Doc improvement
  • Tutorial about tool use
  • Simplified quick start
  • Link to notebook rendering
• Other improvements such as silencing pip install messages, parsing HTML style tags, getting list of actors from directory service.

Thanks to @skzhang1 @jackgerrits @BeibinLi @davorrunje @ekzhu @olgavrou @WaelKarkoub @rajan-chari @eltociear @jamesliu @shouldnotappearcalm and all the other contributors!

What's Changed

• Fix link in non-openai model doc by @ekzhu in https://github.com/microsoft/autogen/pull/2106
• mypy in pre-commit fixed by @davorrunje in https://github.com/microsoft/autogen/pull/2117
• Silences Pip Install Messages in Code Executors by @WaelKarkoub in https://github.com/microsoft/autogen/pull/2105
• Update agentchat_nestedchat_optiguide.ipynb by @eltociear in https://github.com/microsoft/autogen/pull/2122
• Removing tool use from Use-Cases/agent_chat by @ekzhu in https://github.com/microsoft/autogen/pull/2120
• Update docs for new executors by @ekzhu in https://github.com/microsoft/autogen/pull/2119
• missing jupyter when import JupyterCodeExecutor by @jamesliu in https://github.com/microsoft/autogen/pull/2132
• Add vision capability by @BeibinLi in https://github.com/microsoft/autogen/pull/2025
• Native tool call support for Mistral AI API and topic notebook. by @ekzhu in https://github.com/microsoft/autogen/pull/2135
• New conversational chess notebook using nested chats and tool use by @ekzhu in https://github.com/microsoft/autogen/pull/2137
• add webarena in samples by @olgavrou in https://github.com/microsoft/autogen/pull/2114
• context to kwargs by @qingyun-wu in https://github.com/microsoft/autogen/pull/2064
• Bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /website by @dependabot in https://github.com/microsoft/autogen/pull/2131
• Parse Any HTML-esh Style Tags by @WaelKarkoub in https://github.com/microsoft/autogen/pull/2046
• Integrate AgentOptimizer by @skzhang1 in https://github.com/microsoft/autogen/pull/1767
• Introducing IOStream protocol and adding support for websockets by @davorrunje in https://github.com/microsoft/autogen/pull/1551
• [CAP] [Feature] Get list of actors from directory service. by @rajan-chari in https://github.com/microsoft/autogen/pull/2073
• Mark cache as a protocol and update type hints to reflect by @jackgerrits in https://github.com/microsoft/autogen/pull/2168
• fix(): fix word spelling errors by @shouldnotappearcalm in https://github.com/microsoft/autogen/pull/2171
• Implement User Defined Functions for Local CLI Executor by @jackgerrits in https://github.com/microsoft/autogen/pull/2102
• simplify getting-started; update news by @sonichi in https://github.com/microsoft/autogen/pull/2175
• update AgentOptimizer docs by @skzhang1 in https://github.com/microsoft/autogen/pull/2178
• Fix formatting of admonitions in udf docs by @jackgerrits in https://github.com/microsoft/autogen/pull/2188
• Fix iostream on new thread by @davorrunje in https://github.com/microsoft/autogen/pull/2181
• Add link for rendering notebooks docs on website by @jackgerrits in https://github.com/microsoft/autogen/pull/2191

New Contributors

• @jamesliu made their first contribution in https://github.com/microsoft/autogen/pull/2132
• @shouldnotappearcalm made their first contribution in https://github.com/microsoft/autogen/pull/2171

Full Changelog: https://github.com/microsoft/autogen/compare/v0.2.20...v0.2.21