Highlights

1. More detailed documentation

Thank you to the community contributors for helping us improve the documentation. We have improved many documents, including both Chinese and English versions. Please refer to the documentation for more details.

2. New algorithms

• Support Prompt-to-prompt, DDIM Inversion and Null-text Inversion. Click to View.

From right to left: origin image, DDIM inversion, Null-text inversion

Prompt-to-prompt Editing

cat -> dog

spider man -> iron man(attention replace)

Effel tower -> Effel tower at night (attention refine)

blossom sakura tree -> blossom(-3) sakura tree (attention reweight)

• Support Textual Inversion. Click to view.

• Support Attention Injection for more stable video generation with controlnet. Click to view.
• Support Stable Diffusion Inpainting. Click to view.

New Features & Improvements

• [Enhancement] Support noise offset in stable diffusion training by @LeoXing1996 in https://github.com/open-mmlab/mmagic/pull/1880
• [Community] Support Glide Upsampler by @Taited in https://github.com/open-mmlab/mmagic/pull/1663
• [Enhance] support controlnet inferencer by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1891
• [Feature] support Albumentations augmentation transformations and pipeline by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1894
• [Feature] Add Attention Injection for unet by @liuwenran in https://github.com/open-mmlab/mmagic/pull/1895
• [Enhance] update benchmark scripts by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1907
• [Enhancement] update mmagic docs by @crazysteeaam in https://github.com/open-mmlab/mmagic/pull/1920
• [Enhancement] Support Prompt-to-prompt, ddim inversion and null-text inversion by @FerryHuang in https://github.com/open-mmlab/mmagic/pull/1908
• [CodeCamp2023-302] Support MMagic visualization and write a user guide by @aptsunny in https://github.com/open-mmlab/mmagic/pull/1939
• [Feature] Support Textual Inversion by @LeoXing1996 in https://github.com/open-mmlab/mmagic/pull/1822
• [Feature] Support stable diffusion inpaint by @Taited in https://github.com/open-mmlab/mmagic/pull/1976
• [Enhancement] Adopt BaseModule for some models by @LeoXing1996 in https://github.com/open-mmlab/mmagic/pull/1543
• [MMSIG]支持 DeblurGANv2 inference by @xiaomile in https://github.com/open-mmlab/mmagic/pull/1955
• [CodeCamp2023-647] Add new configs of EG3D by @RangeKing in https://github.com/open-mmlab/mmagic/pull/1985

Bug Fixes

• Fix dtype error in StableDiffusion and DreamBooth training by @LeoXing1996 in https://github.com/open-mmlab/mmagic/pull/1879
• Fix gui VideoSlider bug by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1885
• Fix init_model and glide demo by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1888
• Fix InstColorization bug when dim=3 by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1901
• Fix sd and controlnet fp16 bugs by @Z-Fran in https://github.com/open-mmlab/mmagic/pull/1914
• Fix num_images_per_prompt in controlnet by @LeoXing1996 in https://github.com/open-mmlab/mmagic/pull/1936
• Revise metafile for sd-inpainting to fix inferencer init by @LeoXing1996 in https://github.com/open-mmlab/mmagic/pull/1995

New Contributors

• @wyyang23 made their first contribution in https://github.com/open-mmlab/mmagic/pull/1886
• @yehuixie made their first contribution in https://github.com/open-mmlab/mmagic/pull/1912
• @crazysteeaam made their first contribution in https://github.com/open-mmlab/mmagic/pull/1920
• @BUPT-NingXinyu made their first contribution in https://github.com/open-mmlab/mmagic/pull/1921
• @zhjunqin made their first contribution in https://github.com/open-mmlab/mmagic/pull/1918
• @xuesheng1031 made their first contribution in https://github.com/open-mmlab/mmagic/pull/1923
• @wslgqq277g made their first contribution in https://github.com/open-mmlab/mmagic/pull/1934
• @LYMDLUT made their first contribution in https://github.com/open-mmlab/mmagic/pull/1933
• @RangeKing made their first contribution in https://github.com/open-mmlab/mmagic/pull/1930
• @xin-li-67 made their first contribution in https://github.com/open-mmlab/mmagic/pull/1932
• @chg0901 made their first contribution in https://github.com/open-mmlab/mmagic/pull/1931
• @aptsunny made their first contribution in https://github.com/open-mmlab/mmagic/pull/1939
• @YanxingLiu made their first contribution in https://github.com/open-mmlab/mmagic/pull/1943
• @tackhwa made their first contribution in https://github.com/open-mmlab/mmagic/pull/1937
• @Geo-Chou made their first contribution in https://github.com/open-mmlab/mmagic/pull/1940
• @qsun1 made their first contribution in https://github.com/open-mmlab/mmagic/pull/1956
• @ththth888 made their first contribution in https://github.com/open-mmlab/mmagic/pull/1961
• @sijiua made their first contribution in https://github.com/open-mmlab/mmagic/pull/1967
• @MING-ZCH made their first contribution in https://github.com/open-mmlab/mmagic/pull/1982
• @AllYoung made their first contribution in https://github.com/open-mmlab/mmagic/pull/1996