Highlights

• fix the bug that may have grad overflow when total_steps is small
• fix the rotary_emb.inv_freq KeyError in tool convert2hf.py
• add unit test for model

What's Changed

🚀 Features

• feat(core/trainer.py): add more tgs metrics by @li126com in https://github.com/InternLM/InternLM/pull/310

🐞 Bug fixes

• fix(convert2hf.py): fix the rotary_emb.inv_freq KeyError by @jiangtann in https://github.com/InternLM/InternLM/pull/299
• fix(configs/7B_sft.py): model dtype float16 to bfloat16 by @huangting4201 in https://github.com/InternLM/InternLM/pull/302
• fix(chat): fix stream_chat to return generator by @zhjunqin in https://github.com/InternLM/InternLM/pull/123

📚 Documentations

• docs(doc/code-docs): update quickstart usage by @huangting4201 in https://github.com/InternLM/InternLM/pull/301
• docs(doc/code-docs): add figure for training docs by @zigzagcai in https://github.com/InternLM/InternLM/pull/307

✅ Tests

• tests(tests/test_model): add unit test for model by @li126com in https://github.com/InternLM/InternLM/pull/300
• tests(tests/test_solver): add unit test for optimizer by @li126com in https://github.com/InternLM/InternLM/pull/303

🌐 Other

Known issues

Full Changelog: https://github.com/InternLM/InternLM/compare/v0.2.1dev20230909...v0.2.1dev20230915