What's Changed

• Release/0.3.0 by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/102
• Create dataloader on trainer init() by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/92
• label smoothing will not work without alpha set by @A-Jacobson in https://github.com/mosaicml/composer/pull/100
• Warmup and cosine annealing warm restarts combine sequentially by @jacobfulano in https://github.com/mosaicml/composer/pull/99
• Moved device.prepare() to init by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/111
• run_event for callbacks, removed deferred logging by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/85
• Remove composer.trainer.ddp; replace with composer.utils.ddp by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/105
• Running callbacks befor algorithms for the INIT event in the engine by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/113
• Replaced atexit with cleanup methods by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/112
• Deepspeed Integration by @jbloxham in https://github.com/mosaicml/composer/pull/109
• Fix loss reporting by @jbloxham in https://github.com/mosaicml/composer/pull/130
• Run Directory Uploader by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/101
• Dataloader Upgrades by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/114
• Synthetic Datasets and Subset Sampling by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/110
• Remove argparse from setup.py by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/131
• Fixed pickling of torch.memory_format objects by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/132
• Fixed issue #135; rename total_batch_size to train_batch_size by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/137
• Implement MosaicMLLoggerBackend by @ajaysaini725 in https://github.com/mosaicml/composer/pull/81
• Add a linear learning rate decay by @moinnadeem in https://github.com/mosaicml/composer/pull/142
• Apply channels last on init by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/147
• Update Trainer checkpointing documentation by @moinnadeem in https://github.com/mosaicml/composer/pull/150
• Address crashes with DDP + Checkpointing by @moinnadeem in https://github.com/mosaicml/composer/pull/151
• Sudo in the dockerimage by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/152
• Remove curriculum learning by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/164
• Remove broken symlinks by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/163
• Removed dataclass from state by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/153
• Guard artifact uploading in wandb with ddp barriers by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/162
• add CODE_OF_CONDUCT.md by @kobindra in https://github.com/mosaicml/composer/pull/160
• [XS] Fix wandb logger by @jbloxham in https://github.com/mosaicml/composer/pull/172
• Print help on run_mosaic_trainer.py, cleaned up verbosity. by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/170
• DeepSpeed ZeRO config options by @jbloxham in https://github.com/mosaicml/composer/pull/166
• DDP Seeding Across Processes by @ajaysaini725 in https://github.com/mosaicml/composer/pull/173
• Fixed the run directory uploader test by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/177
• Fix broken gpu tests by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/181
• Conditionally skip tests when installed with mosaicml[dev] by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/185
• A yapf update broke some formatting...re-running the linter by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/188
• Timer PR parts 1 and 2 from #146 by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/174
• Fixed pyright issues by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/198
• Additional Tests by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/191
• Propagate processes that were sigkilled by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/184
• Add the ability to load a checkpoint without restoring state by @moinnadeem in https://github.com/mosaicml/composer/pull/169
• Add ResNet-9 for CIFAR-10 by @dblalock in https://github.com/mosaicml/composer/pull/193
• Added helper methods for torch.distributed.boradcast by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/189
• Checkpointing & DeepSpeed by @jbloxham in https://github.com/mosaicml/composer/pull/199
• Distinguish between dist and DDP by @jbloxham in https://github.com/mosaicml/composer/pull/201
• DeepSpeed precision fixes for CV by @jbloxham in https://github.com/mosaicml/composer/pull/197
• Fix deterministic mode (and use it for tests); simplify checkpointing tests by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/203
• Load checkpoints from cloud storage by @ravirahman in https://github.com/mosaicml/composer/pull/200
• Updated the DataSpec for the timing abstraction (#146) parts 3 and 4 by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/178
• Add larger GPT models by @jbloxham in https://github.com/mosaicml/composer/pull/213
• Add BERT Base to Composer by @moinnadeem in https://github.com/mosaicml/composer/pull/195
• Integrate the timer into the training loop by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/210
• Dockerfile enhancements by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/182
• Adding checkpointing at the end of training by @moinnadeem in https://github.com/mosaicml/composer/pull/219
• Adding conditional branching on data_collator by @moinnadeem in https://github.com/mosaicml/composer/pull/220
• Fixes apt sources bug fix by @Averylamp in https://github.com/mosaicml/composer/pull/231
• Remove old timing calls from layer freezing by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/216
• Require pip install -e be pip install --user -e when running as root by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/232
• DeepLabv3 + ADE20k benchmark by @Landanjs in https://github.com/mosaicml/composer/pull/107
• Remove old timing calls from selective backprop by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/221
• Clean up the tests to make them work on jenkins by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/233
• Make the run directory rank-local; fix checkpoints saving and restoring by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/215
• Cleaned Up State by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/223
• Fix the speed monitor by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/238
• Fixed loggers and callbacks by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/240
• Fix ade20k padding fill calculation by @Landanjs in https://github.com/mosaicml/composer/pull/250
• Adding fix for NLP learning rates by @moinnadeem in https://github.com/mosaicml/composer/pull/235
• Training Loop Profiler by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/97
• WIP: Composer Jenkinsfile by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/82
• Fix broken tests by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/257
• Fix bug with AFTER_DATALOADER event; remove microbatches from state by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/258
• Remove the DDP DataLoader by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/245
• Fix Jenkins to work on PRs from Forks by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/267
• add ability to specify custom run name, with rank auto-appended by @dblalock in https://github.com/mosaicml/composer/pull/264
• Remove secrets from the yaml by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/261
• Checkpoint logging and doc fixes by @ajaysaini725 in https://github.com/mosaicml/composer/pull/270
• Remove custom W&B config changes by @siriuslee in https://github.com/mosaicml/composer/pull/236
• Dramatically increase default dist_timeout by @jbloxham in https://github.com/mosaicml/composer/pull/272
• Add factorization by @dblalock in https://github.com/mosaicml/composer/pull/53
• Allow str and dict in Trainer init signature by @hanlint in https://github.com/mosaicml/composer/pull/277
• Add kwargs back to the closure by @jbloxham in https://github.com/mosaicml/composer/pull/292
• Default to num_classes=10 for CIFAR10_ResNet56 by @hanlint in https://github.com/mosaicml/composer/pull/293
• Use tqdm.auto for notebooks by @hanlint in https://github.com/mosaicml/composer/pull/298
• Added ResNet20 by @growlix in https://github.com/mosaicml/composer/pull/289
• Optimizer Surgery by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/249
• Don't init dist when world_size is 1 by @jbloxham in https://github.com/mosaicml/composer/pull/311
• Scheduler defaults to step-wise instead of epoch-wise by @hanlint in https://github.com/mosaicml/composer/pull/312
• Added the version to composer.init by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/315
• Rename checkpoint API by @hanlint in https://github.com/mosaicml/composer/pull/281
• Update setup.py by @Averylamp in https://github.com/mosaicml/composer/pull/321
• Timm support by @A-Jacobson in https://github.com/mosaicml/composer/pull/262
• [XS] use correct package name in error messages by @jbloxham in https://github.com/mosaicml/composer/pull/331
• Multiple Evaluator Datasets by @anisehsani in https://github.com/mosaicml/composer/pull/120
• Fixed all uses of textwrap.dedent by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/332
• Remove explicit YAHP constructs from algorithms by @jbloxham in https://github.com/mosaicml/composer/pull/317
• Configure DeepSpeed with an ordinary DeepSpeed config dict by @jbloxham in https://github.com/mosaicml/composer/pull/322
• Run Event.BATCH_END and Event.EPOCH_END after the timer is increm… by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/310
• Guard dist.barrier in the checkpointer with try/finally by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/334
• Replace composer ResNet with torchvision ResNet by @Landanjs in https://github.com/mosaicml/composer/pull/314
• Fail fast if any step fails by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/333
• Replace most instances of "Mosaic" with "Composer" by @jbloxham in https://github.com/mosaicml/composer/pull/335
• Ensure that the training dataloader does not have an active iterator. by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/337
• Fully flatten checkpoint params by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/325
• Added Pylint and docformatter by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/339
• Add compression flag by @mvpatel2000 in https://github.com/mosaicml/composer/pull/336
• Fix cutmix and mixup reliance on num_classes model attribute by @Landanjs in https://github.com/mosaicml/composer/pull/348
• Copy extra_init_params to get rid of recursive config dicts by @siriuslee in https://github.com/mosaicml/composer/pull/316
• Composer Style Guide by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/319
• Get rid of create_from_hparams by @jbloxham in https://github.com/mosaicml/composer/pull/351
• Added In Memory Logger, Timestamp Object by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/352
• Fix Checkpoints by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/359
• Add channels last standalone function by @dblalock in https://github.com/mosaicml/composer/pull/356
• Quick style guide typo fix by @ajaysaini725 in https://github.com/mosaicml/composer/pull/360
• Removed template_default fields in hparams by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/369
• removed byo_trainer by @anisehsani in https://github.com/mosaicml/composer/pull/374
• Fix sample SD inference multiplication by @Landanjs in https://github.com/mosaicml/composer/pull/376
• Support import composer.functional as cf by @dblalock in https://github.com/mosaicml/composer/pull/368
• Fix composer.functional page no longer showing functions by @dblalock in https://github.com/mosaicml/composer/pull/379
• Testing trainer.fit on each algorithm, callback, logger, and profiler by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/371
• Functional API renaming part 1 by @dblalock in https://github.com/mosaicml/composer/pull/380
• Updated add_dataset_transform() to have flexible insertion point by @growlix in https://github.com/mosaicml/composer/pull/320
• Rename Event.TRAINING_START to Event.FIT; remove Event.TRAINING_END by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/263
• Remove requirement for validation and metrics by @hanlint in https://github.com/mosaicml/composer/pull/378
• Docs Refactor by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/386
• Documentation Outline by @ajaysaini725 in https://github.com/mosaicml/composer/pull/302
• Fix tests without DDP by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/389
• Use Makefile instead of scripts; enable easier testing by @hanlint in https://github.com/mosaicml/composer/pull/387
• Address Doc Fixes for Surgery and StochasticDepth by @ajaysaini725 in https://github.com/mosaicml/composer/pull/413
• Cleanup conftest.py by @hanlint in https://github.com/mosaicml/composer/pull/390
• Move world_size guard to trainer by @hanlint in https://github.com/mosaicml/composer/pull/392
• Add defaults to functional API / share defaults across interfaces by @dblalock in https://github.com/mosaicml/composer/pull/377
• Un-deprecate steps_per_epoch by @jbloxham in https://github.com/mosaicml/composer/pull/418
• Remove the walkthrough section of the docs; replace with module-level docstrings by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/417
• Rename Loggers by @hanlint in https://github.com/mosaicml/composer/pull/427
• Alternative docs theme: furo by @nqn in https://github.com/mosaicml/composer/pull/341
• Clarify DWD defaults by @abhi-mosaic in https://github.com/mosaicml/composer/pull/410
• Added :ignore-module-all: to docs by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/431
• Configured doctest by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/432
• Functional API renaming part 2 by @dblalock in https://github.com/mosaicml/composer/pull/426
• Pytest Refactor Part 1 by @hanlint in https://github.com/mosaicml/composer/pull/391
• Deprecate scale scheduler algorithm and move to trainer by @jbloxham in https://github.com/mosaicml/composer/pull/438
• Removed dead code from the public library; refactored some imports. by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/437
• Trainer test refactor (pytest refactor phase 2) by @hanlint in https://github.com/mosaicml/composer/pull/393
• Skip saving of direct serialization fields by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/445
• Hide gen_interpolation_lambda in mixup like in cutmix and augmix by @dblalock in https://github.com/mosaicml/composer/pull/449
• Move all AlgorithmHparams classes to shared file by @dblalock in https://github.com/mosaicml/composer/pull/452
• Trainer Docs + Param ordering + Alibi Export by @ajaysaini725 in https://github.com/mosaicml/composer/pull/419
• Up and Running with Composer and Speedup Algorithms Demo Notebook by @growlix in https://github.com/mosaicml/composer/pull/340
• Add NLP tutorial notebook by @Landanjs in https://github.com/mosaicml/composer/pull/370
• add kaggle notebook by @A-Jacobson in https://github.com/mosaicml/composer/pull/381
• Refactor Profiler init() by @bandish-shah in https://github.com/mosaicml/composer/pull/422
• Random doc fixes by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/456
• support integer arguments to Trainer by @hanlint in https://github.com/mosaicml/composer/pull/458
• Make algorithm functions either public or prefixed with "_" by @dblalock in https://github.com/mosaicml/composer/pull/460
• bug in train metrics by @A-Jacobson in https://github.com/mosaicml/composer/pull/466
• Fixes empty log lines if no algorithms are run by @siriuslee in https://github.com/mosaicml/composer/pull/462
• Add default hparam values for cutout by @dblalock in https://github.com/mosaicml/composer/pull/459
• Docstrings for composer.utils by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/439
• notebook tests by @hanlint in https://github.com/mosaicml/composer/pull/468
• resize_targets set to False by default by @siriuslee in https://github.com/mosaicml/composer/pull/475
• Remove dist warnings by @hanlint in https://github.com/mosaicml/composer/pull/474
• Add missing defaults for one function by @dblalock in https://github.com/mosaicml/composer/pull/476
• Store metadata in json files for algorithms by @hanlint in https://github.com/mosaicml/composer/pull/471
• Davis/algos intrafile organization by @dblalock in https://github.com/mosaicml/composer/pull/465
• Get functional API running enough for notebook by @dblalock in https://github.com/mosaicml/composer/pull/479
• Remove colons from run directory timestamps by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/486
• Add custom methods notebook by @coryMosaicML in https://github.com/mosaicml/composer/pull/330
• Move the clean notebooks script to the scripts folder by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/487
• Checkpoint Usability Initial Changes by @ajaysaini725 in https://github.com/mosaicml/composer/pull/455
• Removing HF XFail on model registry by @moinnadeem in https://github.com/mosaicml/composer/pull/490
• Clean up Imports and Tests by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/482
• Ravi/docs cleanup 2 by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/488
• Matthew/docstrings update by @growlix in https://github.com/mosaicml/composer/pull/457
• No autodoc of forward by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/494
• Update init.py by @growlix in https://github.com/mosaicml/composer/pull/493
• allow from composer import ComposerModel by @hanlint in https://github.com/mosaicml/composer/pull/496
• Methods landing page by @nqn in https://github.com/mosaicml/composer/pull/454
• Small docs change to include timing reference by @anisehsani in https://github.com/mosaicml/composer/pull/500
• docstring for callbacks by @dskhudia in https://github.com/mosaicml/composer/pull/470
• Docs cleanup #3 by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/502
• Adding network fixes for the Run Directory Uploader by @moinnadeem in https://github.com/mosaicml/composer/pull/505
• Adding network retries for downloading GLUE by @moinnadeem in https://github.com/mosaicml/composer/pull/506
• Matthew/loggers docstrings by @growlix in https://github.com/mosaicml/composer/pull/499
• Fix Sphinx Warnings by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/520
• Anaconda configuration by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/507
• Update docstrings for Colout, CutOut, CutMix, Layer Freezing, Mixup, Label Smoothing, Progressive Resizing by @coryMosaicML in https://github.com/mosaicml/composer/pull/483
• Stateless schedulers by @jbloxham in https://github.com/mosaicml/composer/pull/463
• Rename selective_backprop to select_using_loss by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/532
• Update new README by @hanlint in https://github.com/mosaicml/composer/pull/540
• Fix dark mode by @nqn in https://github.com/mosaicml/composer/pull/573
• Fix the run directory uploader when use_procs=True and not using the … by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/547
• Console font too bright by @nqn in https://github.com/mosaicml/composer/pull/574
• Fix pil_image_collate by @Landanjs in https://github.com/mosaicml/composer/pull/514
• ADE20k DeepLabv3 optimized benchmark yaml by @Landanjs in https://github.com/mosaicml/composer/pull/579
• separate hparams in module docstrings by @hanlint in https://github.com/mosaicml/composer/pull/558
• Fix DataloaderHparam docs by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/534
• per #224, update function to use Timer and Time by @jzf2101 in https://github.com/mosaicml/composer/pull/583
• Clean up Transformer models init function by @moinnadeem in https://github.com/mosaicml/composer/pull/587
• Docstrings for composer.trainer by @ajaysaini725 in https://github.com/mosaicml/composer/pull/522
• Additional updates to the loggers docstrings by @growlix in https://github.com/mosaicml/composer/pull/544
• Profiler docstrings by @bandish-shah in https://github.com/mosaicml/composer/pull/473
• Updated Model Cards by @ajaysaini725 in https://github.com/mosaicml/composer/pull/375
• Unify augmentation API part 1 by @dblalock in https://github.com/mosaicml/composer/pull/524
• Docstrings improvements for core.algorithm, core.callback, etc. by @dskhudia in https://github.com/mosaicml/composer/pull/516
• Skip ResNet50 + DeepSpeed tests that are timing out by @hanlint in https://github.com/mosaicml/composer/pull/601
• Make the default split_batch method a no-op if grad_accum is 1. by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/592
• Add functional/standalone API tutorial notebook by @dblalock in https://github.com/mosaicml/composer/pull/326
• Merge v0.4 fixes by @hanlint in https://github.com/mosaicml/composer/pull/606
• updated docstring examples by @growlix in https://github.com/mosaicml/composer/pull/600
• [v0.4rc] Documentation Guides by @hanlint in https://github.com/mosaicml/composer/pull/531
• Method cards by @jfrankle in https://github.com/mosaicml/composer/pull/589
• Improved docstring for surgery algorithms by @dblalock in https://github.com/mosaicml/composer/pull/602
• Fix Lint by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/611
• Fix Lint by @ravi-mosaicml in https://github.com/mosaicml/composer/pull/612
• Updated 'Up and Running with Composer' by @growlix in https://github.com/mosaicml/composer/pull/619
• Release v0.4.0 by @hanlint in https://github.com/mosaicml/composer/pull/609

New Contributors

• @A-Jacobson made their first contribution in https://github.com/mosaicml/composer/pull/100
• @jacobfulano made their first contribution in https://github.com/mosaicml/composer/pull/99
• @kobindra made their first contribution in https://github.com/mosaicml/composer/pull/160
• @ravirahman made their first contribution in https://github.com/mosaicml/composer/pull/200
• @Landanjs made their first contribution in https://github.com/mosaicml/composer/pull/107
• @siriuslee made their first contribution in https://github.com/mosaicml/composer/pull/236
• @mvpatel2000 made their first contribution in https://github.com/mosaicml/composer/pull/336
• @abhi-mosaic made their first contribution in https://github.com/mosaicml/composer/pull/410
• @jzf2101 made their first contribution in https://github.com/mosaicml/composer/pull/583
• @jfrankle made their first contribution in https://github.com/mosaicml/composer/pull/589

Full Changelog: https://github.com/mosaicml/composer/compare/v0.3.1...v0.4.0