New Features

• [New Features] Add metric option to checkpoint averaging for Transformer #2259 by @hirofumi0810
• [New Features][ESPnet2] Generate run.sh in the experiment dir for resuming #2284 by @kamo-naoyuki
• [New Features][ESPnet2] Support larger num_iters_per_epoch than the number of batches in small corpus #2255 by @kamo-naoyuki
• [New Features][ESPnet2] Support torch native automatic mixed precision for espnet2 #2257 by @kamo-naoyuki

Documentation

• [Documentation] Update comments in MultiHeadAttention #2266 by @placebokkk
• [Documentation][ESPnet2] append comment in reporter.py #2267 by @kamo-naoyuki
• [Documentation][ESPnet2][README][TTS] Add ESPnet2 TTS recipe document #2312 by @kan-bayashi

Enhancement

• [Enhancement][ESPnet2] Tensorboard stats between iterations #2252 by @kamo-naoyuki

Refactoring

• [Refactoring][ESPnet2] Add some new features and a new recipe for the enhancement task #2238 by @Emrys365
• [Refactoring][Documentation] Remove installation part of Python from Makefile #2245 by @kamo-naoyuki

Recipe

• [Recipe][ASR] aidatatang conformer ESPnet1 recipe #2269 by @nzhoward
• [Recipe][ESPnet2] espnet2 zeroth_korean recipe #2279 by @hchung12

Bug fix

• [Bugfix] Fix #2295 #2311 by @kan-bayashi
• [Bugfix] Minor fix for Makefile #2268 by @kamo-naoyuki
• [Bugfix] Not to install cupy-cuda* for python>=3.8 #2277 by @kamo-naoyuki
• [Bugfix] Remove channel: setup_anaconda.sh #2303 by @kamo-naoyuki
• [Bugfix][ASR] ngram single decoding bug fix #2299 by @qmpzzpmq
• [Bugfix][ASR][ESPnet2] Add missing init.py #2292 by @kamo-naoyuki
• [Bugfix][ASR][ESPnet2] decode -> inference #2276 by @kamo-naoyuki
• [Bugfix][ASR][ESPnet2] remove chainer dependency from show_asr_result.sh #2281 by @kamo-naoyuki
• [Bugfix][ESPnet2] Avoid illegal summary name for tensorboard #2294 by @kamo-naoyuki
• [Bugfix][ESPnet2] Fix average_nbest_models for pytorch=1.6 #2283 by @kamo-naoyuki
• [Bugfix][ESPnet2] Fix decode config extension in ESPnet2 CSJ recipe #2258 by @kan-bayashi
• [Bugfix][ESPnet2] Fix for queue-freegpu.pl #2274 by @kamo-naoyuki
• [Bugfix][ESPnet2] Fix samplers about min_batch_size #2305 by @kamo-naoyuki
• [Bugfix][ESPnet2] Workaround for SGE jobname issue #2253 by @kamo-naoyuki
• [Bugfix][ESPnet2] add missing shebang #2306 by @kamo-naoyuki
• [Bugfix][ESPnet2] fix bug of reporter #2263 by @kamo-naoyuki
• [Bugfix][ESPnet2][Recipe] Update zeroth_korean #2308 by @kamo-naoyuki
• [Bugfix][ESPnet2][SE] add --spk-num 1 #2285 by @kamo-naoyuki
• [Bugfix][ESPnet2][distributed] Not to save config.yaml if rank!=0 #2287 by @kamo-naoyuki

Others

• [CI] Remove unnecessary installation when CI #2307 by @kamo-naoyuki
• [CI] Take integration tests into coverage #2254 by @ShigekiKarita
• [CI][ESPnet2] Add coverage measure for espnet2 integration test #2256 by @kamo-naoyuki
• [CI][Installation] Install wheel #2304 by @kamo-naoyuki

Acknowledgements

Special thanks to @Emrys365, @ShigekiKarita, @hchung12, @hirofumi0810, @kamo-naoyuki, @kan-bayashi, @nzhoward, @placebokkk, @qmpzzpmq.