🌟 OpenCompass v0.3.3 Release Log The OpenCompass team is thrilled to announce the release of OpenCompass v0.3.3!

🚀 New Features

• 🔧 Added support for the SciCode summarizer configuration.
• 🛠 Introduced support for internal Followbench.
• 🔧 Updated models and configurations for MathBench & WikiBench under FullBench.
• 🛠 Enhanced support for OpenAI O1 models and Qwen2.5 Instruct.
• 🔧 Included a postprocess function for custom models.
• 🛠 Added InternTrain feature for broader model training scenarios.

📖 Documentation

• 📚 Updated the README with the latest information on how to use OpenCompass effectively.

🐛 Bug Fixes

• 🔧 Fixed issues with the link-check workflow and wildbench.
• 🛠 Resolved errors in partitioning and corrected typos throughout the codebase.
• 🔧 Addressed compatibility issues with lmdeploy interface type changes.
• 🛠 Fixed the followbench dataset configuration and token settings.

⚙ Enhancements and Refactors

• 🛠 Enhanced support for verbose output in OpenAI API interactions.
• 🔧 Updated maximum output length configurations for multiple models.
• 🛠 Improved handling of the "begin section" in meta_template for better parsing.
• 🔧 Added a common summarizer for qabench and expanded test coverage for various models.

🎉 Welcome New Contributors 👋 We'd like to extend a warm welcome to our new contributors who have made their first contributions to OpenCompass:

• @x54-729 introduced InternTrain.
• @chuanyangjin helped correct typos.
• @cuauty added support for reasoning from BaiLing LLM.

Thank you to all our contributors for making this release possible!

Full Changelog: https://github.com/open-compass/opencompass/compare/0.3.2.post1...0.3.3