AdaLomo

版本发布时间: 2023-10-24 15:23:13

OpenLMLab/LOMO最新发布版本:v0.1.1(2024-07-02 22:57:28)

Add AdaLomo, a more powerful and equally efficient optimizer. https://arxiv.org/abs/2310.10195.
The code is easier to use based on collie (dev-branch currently).