The OpenCompass team is thrilled to announce the release of OpenCompass v0.3.2!

🚀 New Features

• 🛠 Added extra_body support for OpenAISDK and introduced proxy URL support when connecting to OpenAI's API.
• 🗂 Included auto-download functionality for Mmlu-pro, Needlebench, Longbench and other datasets.
• 🤝 Integrated support for the Rendu API.
• 🧪 Added a model postprocess function.

📖 Documentation

• 📜 Updated the README file for better clarity and guidance.

🐛 Bug Fixes

• 🛠 Fixed CLI evaluation for multiple models.
• 🛠 Updated requirements to resolve dependency issues.
• 🛠 Corrected configurations for the Llama model series.
• 🛠 Addressed bad cases and added environment information to improve testing.

⚙ Enhancements and Refactors

• 🛠 Made OPENAI_API_BASE compatible with OpenAI's default environment settings.
• 🛠 Optimized SciCode for improved performance.
• 🛠 Added an api_key attribute to TurboMindAPIModel.
• 🛠 Implemented fixes and improvements to the CI test environment, including baselines for vllm.

🎉 Welcome New Contributors

• 👋 @cpa2001 contributed with the addition of icl_sliding_k_retriever.py and updates to __init__.py.
• 👋 @gyin94 made the OPENAI_API_BASE compatible with OpenAI's default environment.
• 👋 @chengyingshe added an attribute api_key into TurboMindAPIModel.
• 👋 @yanzeyu supported the integration of Rendu API.

Full Changelog: https://github.com/open-compass/opencompass/compare/0.3.1...0.3.2