Perp-Neg for Editing Models
andreemic opened this issue · 1 comments
andreemic commented
Hey!
I really loved your work on this and think this can be very powerful in the context of image editing with diffusion models, like done by InstructPix2Pix.
There, the authors propose to have two-way CFG between
- unconditional generation,
- only image-conditional generation, and
- image- and text-conditional generation
So you end up with something like this:
How could we apply the Perp-Neg idea there? How would the idea map to this three-way CFG?