New Feature

• [New Features][ESPnet2] Wandb integration #2707 by @kamo-naoyuki
• [New Features][ESPnet2][ASR] Add ignore_nan_grad option for CTC #2699 by @kamo-naoyuki
• [New Features][ESPnet2][SE] Touching common modules before the main Enh PR #2705 by @LiChenda

Bug fix

• [Bugfix][ESPnet1] bug fix for pytorch1.7 #2656 by @kamo-naoyuki
• [Bugfix][ESPnet1][ESPnet2][TTS] Use nkf in CSMSC data prep #2726 by @kan-bayashi
• [Bugfix][ESPnet2] Fix flooring for global_mvn.py #2623 by @kamo-naoyuki
• [Bugfix][ESPnet2] Fix small bug of tensorboard part #2702 by @kamo-naoyuki
• [Bugfix][ESPnet2] Fix wandb mode with multi gpus #2709 by @kamo-naoyuki
• [Bugfix][ESPnet2][TTS] Fix token averaged feature the case when r > 1 #2704 by @kan-bayashi

Recipe

• [Recipe][ESPnet1] Extend model averaging condition in run scripts #2613 by @b-flo
• [Recipe][ESPnet1][ASR] Enable multi-thread processing of json files. #2681 by @Peidong-Wang
• [Recipe][ESPnet1][ASR] Update KsponSpeech conformer results #2624 by @jubang0219
• [Recipe][ESPnet1][ASR] Update Voxforge with Conformer results #2642 by @YosukeHiguchi
• [Recipe][ESPnet1][ASR] lang was being used before being parsed for user input #2654 by @siddalmia
• [Recipe][ESPnet1][ASR][ESPnet2][Installation][README] espnet2 reverb recipe #2691 by @kamo-naoyuki
• [Recipe][ESPnet1][ASR][README] Update Switchboard with conformer results #2697 by @Emrys365
• [Recipe][ESPnet1][ASR][README] add librispeech conformer w/ speed perturbation + specaug #2617 by @yuekaizhang
• [Recipe][ESPnet2][ASR] ASR template recipe: --srctexts -> --lm_train_text, --bpe_train_text #2660 by @kamo-naoyuki
• [Recipe][ESPnet2][ASR] Add $token_type to asr_tag and lm_tag #2625 by @kamo-naoyuki
• [Recipe][ESPnet2][ASR][Installation][README][Recipe] Laborotv recipe #2703 by @sw005320
• [Recipe][ESPnet2][ASR][README] Add AISHELL w/o LM result #2718 by @kamo-naoyuki
• [Recipe][ESPnet2][ASR][README] ESPnet2 recipe for TIMIT #2568 by @sknadig
• [Recipe][ESPnet2][ASR][README] JSUT conformer recipe achieving 12.0/13.9 CER(%) for dev/eval1 #2720 by @hchung12
• [Recipe][ESPnet2][ASR][README] Update README.md #2659 by @sw005320
• [Recipe][ESPnet2][ASR][README] Update WSJ result #2628 by @kamo-naoyuki
• [Recipe][ESPnet2][ASR][README] espnet2 librispeech with conformer #2687 by @sw005320
• [Recipe][ESPnet2][README] Corpus README in egs2 #2713 by @sw005320
• [Recipe][ESPnet2][README] update egs2/README.md #2719 by @Emrys365

Enhancement

• [Enhancement][Documentation][ESPnet2] Add --init_param option #2680 by @kamo-naoyuki
• [Enhancement][ESPnet1][ASR] Save model snapshot at every epoch even if save_interval_iters > 0 - for model averaging #2637 by @sknadig
• [Enhancement][ESPnet2] Update wandb part #2708 by @kamo-naoyuki
• [Enhancement][ESPnet2][ASR] Add *_stats_dir options in asr.sh #2724 by @kan-bayashi

Documentation

• [Documentation][ESPnet2][README] Update egs2 README #2723 by @kan-bayashi
• [Documentation][ESPnet2][README][TTS] Update README about fine-tuning #2685 by @kan-bayashi
• [Documentation][ESPnet2][README][TTS] Update TTS README.md #2650 by @kan-bayashi

Refactoring

• [Refactoring][ESPnet1][ASR][README] Refactor Mask CTC non-autoregressive ASR #2223 by @YosukeHiguchi
• [Refactoring][ESPnet2] Added unicode support for generated configs #2672 by @Piteryo

Others

• [Installation] python setup.py install -> pip install -e #2619 by @kamo-naoyuki
• [Installation][Refactoring] modify for zsh: tools/extra_path.sh #2696 by @kamo-naoyuki
• [Docker] Docker flags for extra libraries (VC) #2622 by @Fhrozen

Acknowledgements

Special thanks to @Emrys365, @Fhrozen, @LiChenda, @Peidong-Wang, @Piteryo, @YosukeHiguchi, @b-flo, @hchung12, @jubang0219, @kamo-naoyuki, @kan-bayashi, @siddalmia, @sknadig, @sw005320, @yuekaizhang.