What's Changed

Key Updates:

1. We now support creating your help documents for each Windows application to become an app expert. Check the [README](./learner/README.md) for more details!
2. UFO now supports RAG from offline documents and online Bing search.
3. You can save the task completion trajectory into its memory for UFO's reference, improving its future success rate!
4. You can customize different GPT models for AppAgent and ActAgent. Text-only models (e.g., GPT-4) are now supported!

Detailed contributions

• Update README.md by @eltociear in https://github.com/microsoft/UFO/pull/1
• fix: word spelling in prompt by @saifeiLee in https://github.com/microsoft/UFO/pull/6
• Fix colorama init by @lserinol in https://github.com/microsoft/UFO/pull/10
• Modify the configuration of AOAI API base and modify the dict of app_selection prompt by @kangyu in https://github.com/microsoft/UFO/pull/12
• Add config file to ignore, and added a template config file for AAD login method by @Mac0q in https://github.com/microsoft/UFO/pull/16
• Develop the RAG with offline doc and online bing search by @vyokky in https://github.com/microsoft/UFO/pull/14
• Develop reformating prompts and readme for offline learner by @vyokky in https://github.com/microsoft/UFO/pull/19
• readme by @vyokky in https://github.com/microsoft/UFO/pull/23
• Vyokky/dev: Support Non-visual mode by @vyokky in https://github.com/microsoft/UFO/pull/24
• OpenAI API by @Mac0q in https://github.com/microsoft/UFO/pull/25
• check in openfile.py by @Lenny2Liu in https://github.com/microsoft/UFO/pull/26
• Vyokky/dev Experience Learning by @vyokky in https://github.com/microsoft/UFO/pull/28
• Add record processor to parse the user behavior record to JSON file by @yunhao0204 in https://github.com/microsoft/UFO/pull/31
• openai config by @Mac0q in https://github.com/microsoft/UFO/pull/32
• Fix the prompts by @AL-377 in https://github.com/microsoft/UFO/pull/33
• Vyokky/executor by @vyokky in https://github.com/microsoft/UFO/pull/34
• Vyokky/dev v0.0.1 New release by @vyokky in https://github.com/microsoft/UFO/pull/36
• release v0.0.1 by @vyokky in https://github.com/microsoft/UFO/pull/38

New Contributors

• @eltociear made their first contribution in https://github.com/microsoft/UFO/pull/1
• @saifeiLee made their first contribution in https://github.com/microsoft/UFO/pull/6
• @lserinol made their first contribution in https://github.com/microsoft/UFO/pull/10
• @kangyu made their first contribution in https://github.com/microsoft/UFO/pull/12
• @Mac0q made their first contribution in https://github.com/microsoft/UFO/pull/16
• @vyokky made their first contribution in https://github.com/microsoft/UFO/pull/14
• @Lenny2Liu made their first contribution in https://github.com/microsoft/UFO/pull/26
• @AL-377 made their first contribution in https://github.com/microsoft/UFO/pull/33

Full Changelog: https://github.com/microsoft/UFO/commits/v0.0.1