What's New

🔥 Support for PyTorch v2.3.0

Composer now supports the recently-released PyTorch version 2.3.0! Please raise any issues with us so we can address them.

Bug Fixes

• Fixing checks for device microbatch size for sequence parallelism in #3200
• Fixing token logging in #3206
• Search for run name in MLFlowLogger in #3215
• Fix FQN names with activation checkpointing in #3210
• Strict weight matching for checkpoint loading in #3219

What's Changed

• Bump transformers by @dakinggg in https://github.com/mosaicml/composer/pull/3197
• Add deprecation warnings for ICL datasets/helper functions/metrics by @bmosaicml in https://github.com/mosaicml/composer/pull/3125
• Bump traitlets from 5.14.2 to 5.14.3 by @dependabot in https://github.com/mosaicml/composer/pull/3204
• Raise LR schedule warnings only when necessary by @snarayan21 in https://github.com/mosaicml/composer/pull/3207
• Add torch 2.3 support by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3209
• Add torch 2.3 CI/CD by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3211
• Fix daily test images by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3212
• Try FAv2 2.5.7 from source by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3213
• Update tests by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3217
• Fix torch 2.3 GPU tests by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3218
• Use flash-attn 2.5.8 with no build isolation in docker images by @snarayan21 in https://github.com/mosaicml/composer/pull/3224
• Add a torch.cuda.empty_cache() in utils.save_checkpoint by @bfontain in https://github.com/mosaicml/composer/pull/3216
• Require 2 steps for GS object store by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3228
• Add rename_metrics to Mlflow logger by @hanlint in https://github.com/mosaicml/composer/pull/3225
• Fix daily tests by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3229
• Change precision for daily tests by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3231
• Create new Mlflow run by default and introduce run_group by @chenmoneygithub in https://github.com/mosaicml/composer/pull/3208
• Fix daily test pt 4 by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3233
• Deprecate and bump version to 0.22 by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3230
• Fix daily tests v5 by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3234
• Fix daily v6 by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3235
• fix daily tests v7 by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3236
• Raise the daily test timeout by @dakinggg in https://github.com/mosaicml/composer/pull/3241
• Accelerate GPU tests by @mvpatel2000 in https://github.com/mosaicml/composer/pull/3237
• Make sharded checkpoint loading backwards-compatible by @snarayan21 in https://github.com/mosaicml/composer/pull/3240

Full Changelog: https://github.com/mosaicml/composer/compare/v0.21.3...v0.22.0