v0.6.4

版本发布时间: 2024-07-19 02:01:23

tatsu-lab/alpaca_eval最新发布版本:v0.6.5(2024-08-18 07:39:20)

What's Changed

Add SPPO-Llama-3-Instruct-8B-PairRM to AlpacaEval by @Edward-Sun in https://github.com/tatsu-lab/alpaca_eval/pull/354
Add Infinity-Instruct-3M-0613-Llama3-70B to AlpacaEval by @cszhengyh in https://github.com/tatsu-lab/alpaca_eval/pull/358
Add SPPO-Gemma-2-9B-It-PairRM to AlpacaEval by @angelahzyuan in https://github.com/tatsu-lab/alpaca_eval/pull/359
Add Infinity-Instruct-3M-0625-Models to AlpacaEval by @cszhengyh in https://github.com/tatsu-lab/alpaca_eval/pull/364
Add Higgs Llama3-70B V2 Results by @sxjscience in https://github.com/tatsu-lab/alpaca_eval/pull/367
Added Ghost 8B Beta (d0x5) model by @lh0x00 in https://github.com/tatsu-lab/alpaca_eval/pull/366
Add gemma-2-9b-it-SimPO and gemma-2-9b-it-DPO to AlpacaEval by @xiamengzhou in https://github.com/tatsu-lab/alpaca_eval/pull/368
[ENH] add CI test for unwanted files by @YannDubs in https://github.com/tatsu-lab/alpaca_eval/pull/369
update model links by @xiamengzhou in https://github.com/tatsu-lab/alpaca_eval/pull/370
[ENH] add the code to compute instruction_following by @YannDubs in https://github.com/tatsu-lab/alpaca_eval/pull/371
[ENH] adding simplified glm by @YannDubs in https://github.com/tatsu-lab/alpaca_eval/pull/372
[BUG] backward compatibility vllm do_sample -> use_beam_search by @YannDubs in https://github.com/tatsu-lab/alpaca_eval/pull/373

Full Changelog: https://github.com/tatsu-lab/alpaca_eval/compare/v0.6.3...v0.6.4