TencentARC/MasaCtrl

Any plans to support SDXL real_image_editing?

wangyong860401 opened this issue · 1 comments

wangyong860401 commented

Any plans to support SDXL real_image_editing?

ljzycmd commented

Hi @wangyong860401, thanks for your interest.

As for the real image editing on the SDXL model, I will add this function in my free time (currently not available due to some deadlines).
Or, you can implement it by yourself with the Diffusers lib easily, by:

  1. Implement DDIM inversion on the SDXL model to obtain the initial inverted noise and intermediate latents;
  2. Override the sampling process of the original SDXL pipeline by integrating the inverted intermediate latents into the denoising process.

Hope this can help you.