BrushNet and PowerPaintV2 can turn any normal sd1.5 model into an inpainting model. When using any SD1.5 base model(e.g: runwayml/stable-diffusion-v1-5), the option for BrushNet/PowerPaintV2 will appear in the sidebar. The model will automatically download the first time it is used.

For BrushNet, there are two models to choose from: brushnet_segmentation_mask and brushnet_random_mask. Using brushnet_segmentation_mask means that the final inpainting result will maintain consistency with the mask shape, while brushnet_random_mask provides a more general ckpt for random mask shapes.

For PowerPaintV2, just like PowerPaintV1, it was trained with "learnable task prompts" to guide the model in achieving specific tasks more effectively. These tasks include text-guided, shape-guided, object-remove, and outpainting.