The big change in the latest release is that the app now confirms to the official Microsoft AI Chat Protocol, documented here: https://github.com/microsoft/ai-chat-protocol/tree/main/spec#readme There is also a JS SDK for that protocol that we will adopt soon to simplify our frontend parsing code. You can see the pull request for more details, but basically:

• Instead of sending "stream": True to get a streaming response, we send to a different path, "/chat/stream".
• Instead of passing down the full choices list from the OpenAI response, we pass down only the first choice, specifically it's message or delta.

We have also updated the evaluator tool to work with either the new version of the backend protocol or the old, configurable via JMESPath expressions in the config JSON.

This change also includes a revamp of the Developer Settings to include tooltips, to try and make it more clear what each setting does.

What's Changed

• Bump the python-requirements group with 26 updates by @dependabot in https://github.com/Azure-Samples/azure-search-openai-demo/pull/1673
• Update deploy_features.md by @hadirgax in https://github.com/Azure-Samples/azure-search-openai-demo/pull/1689
• Add clickable help icons for developer settings by @pamelafox in https://github.com/Azure-Samples/azure-search-openai-demo/pull/1522
• Upgrade to latest version of AI Chat Protocol by @pamelafox in https://github.com/Azure-Samples/azure-search-openai-demo/pull/1682

New Contributors

• @hadirgax made their first contribution in https://github.com/Azure-Samples/azure-search-openai-demo/pull/1689

Full Changelog: https://github.com/Azure-Samples/azure-search-openai-demo/compare/2024-06-03b...2024-06-05