What's Changed

• [Refactor] fix internlm2 dispatch by @HIT-cwh in https://github.com/InternLM/xtuner/pull/779
• Fix zero3 compatibility issue for DPO by @Johnson-Wang in https://github.com/InternLM/xtuner/pull/781
• [Fix] Fix map_fn in custom_dataset/sft by @fanqiNO1 in https://github.com/InternLM/xtuner/pull/785
• [Fix] fix configs by @HIT-cwh in https://github.com/InternLM/xtuner/pull/783
• [Docs] DPO and Reward Model documents by @RangiLyu in https://github.com/InternLM/xtuner/pull/751
• Support internlm2.5 by @HIT-cwh in https://github.com/InternLM/xtuner/pull/803
• [Bugs] fix dispatch bugs when model not in LOWEST_TRANSFORMERS_VERSION by @HIT-cwh in https://github.com/InternLM/xtuner/pull/802
• [Docs] fix benchmark table by @HIT-cwh in https://github.com/InternLM/xtuner/pull/801
• [Feature] support output without loss in openai_map_fn by @HIT-cwh in https://github.com/InternLM/xtuner/pull/816
• [Docs] fix typos in sp docs by @HIT-cwh in https://github.com/InternLM/xtuner/pull/821
• [Feature] Support the DatasetInfoHook of DPO training by @xu-song in https://github.com/InternLM/xtuner/pull/787
• [Enhance]: Fix sequence parallel memory bottleneck in DPO & ORPO by @RangiLyu in https://github.com/InternLM/xtuner/pull/830
• [Fix] Fix typo by @bychen7 in https://github.com/InternLM/xtuner/pull/795
• [Fix] fix initialization of ref_llm for full param dpo training with zero-3 by @xu-song in https://github.com/InternLM/xtuner/pull/778
• [Bugs] Fix attn mask by @HIT-cwh in https://github.com/InternLM/xtuner/pull/852
• fix lint by @HIT-cwh in https://github.com/InternLM/xtuner/pull/854
• [Bugs] Fix dispatch attn bug by @HIT-cwh in https://github.com/InternLM/xtuner/pull/829
• [Docs]: update readme and DPO en docs by @RangiLyu in https://github.com/InternLM/xtuner/pull/853
• Added minicpm config file to support sft、qlora、lora、dpo by @LDLINGLINGLING in https://github.com/InternLM/xtuner/pull/847
• fix lint by @HIT-cwh in https://github.com/InternLM/xtuner/pull/856
• bump version to 0.1.22 by @HIT-cwh in https://github.com/InternLM/xtuner/pull/855

New Contributors

• @Johnson-Wang made their first contribution in https://github.com/InternLM/xtuner/pull/781
• @xu-song made their first contribution in https://github.com/InternLM/xtuner/pull/787
• @bychen7 made their first contribution in https://github.com/InternLM/xtuner/pull/795
• @LDLINGLINGLING made their first contribution in https://github.com/InternLM/xtuner/pull/847

Full Changelog: https://github.com/InternLM/xtuner/compare/v0.1.21...v0.1.22