The OpenCompass team is thrilled to announce the release of OpenCompass v0.2.6!

🌟 Highlights

• No noteworthy highlights.

🚀 New Features

1. #1215 #1224 #1266 Add Datasets MT-Bench-101, Fofo, wildbench
2. #1286 Add Models InternLM2.5-7B

📖 Documentation

1. #1252 Add doc for accelerator function
2. #1263 Update quick start guide

🐛 Bug Fixes

1. #1221 Resolve release version installation and import issues
2. #1228 Fix pip version issues
3. #1282 Update MathBench summarizer & fix cot setting

⚙ Enhancements and Refactors

1. #1284 Reorganize subjective eval

🎉 Welcome New Contributors

• @mqy004, @sefira, @Zor-X-L and @baymax591 made their first contributions. Welcome to the OpenCompass community!

🔗 Full Change Logs

• [Fix] fix summarizer by @bittersweet1999 in https://github.com/open-compass/opencompass/pull/1217
• 解决release版本安装后不能导入opencompass.cli.main的问题 by @mqy004 in https://github.com/open-compass/opencompass/pull/1221
• MT-Bench-101 by @sefira in https://github.com/open-compass/opencompass/pull/1215
• [Feature] add dataset Fofo by @bittersweet1999 in https://github.com/open-compass/opencompass/pull/1224
• [Fix] fix pip version by @bittersweet1999 in https://github.com/open-compass/opencompass/pull/1228
• add ",<2.0.0" to "numpy>=1.23.4" in requirements/runtime.txt, as pand… by @Zor-X-L in https://github.com/open-compass/opencompass/pull/1267
• Support wildbench by @kleinzcy in https://github.com/open-compass/opencompass/pull/1266
• Add doc for accelerator function by @liushz in https://github.com/open-compass/opencompass/pull/1252
• flash attn installation in daily testcase by @zhulinJulia24 in https://github.com/open-compass/opencompass/pull/1272
• Update mtbench101.py by @sefira in https://github.com/open-compass/opencompass/pull/1276
• [Sync] Sync with internal codes 2024.06.28 by @Leymore in https://github.com/open-compass/opencompass/pull/1279
• Update MathBench summarizer & fix cot setting by @liushz in https://github.com/open-compass/opencompass/pull/1282
• npu适配 by @baymax591 in https://github.com/open-compass/opencompass/pull/1250
• [ci] update daily testcase by @zhulinJulia24 in https://github.com/open-compass/opencompass/pull/1285
• [Feature] Add InternLM2.5 by @tonysy in https://github.com/open-compass/opencompass/pull/1286
• [Feat] Update owners for issues by @tonysy in https://github.com/open-compass/opencompass/pull/1293
• [Refactor] Reorganize subjective eval by @bittersweet1999 in https://github.com/open-compass/opencompass/pull/1284
• [Doc] quick start swap tabs by @Leymore in https://github.com/open-compass/opencompass/pull/1263

Full Changelog: https://github.com/open-compass/opencompass/compare/0.2.5...0.2.6