huggingface/diffusers

Implement v-prediction in all schedulers

Closed this issue · 4 comments

pcuenca commented

This would be nice to guarantee scheduler interoperability in Stable Diffusion 2. DDIM, DDPM and EulerDiscrete already support v-prediction, the following ones remain (from the list of compatible stable diffusion schedulers):

  • EulerAncestralDiscreteScheduler
  • PNDMScheduler
  • LMSDiscreteScheduler
  • DPMSolverMultistepScheduler
kashif commented

I will take a stab at the DPMSolverMultistepScheduler scheduler

vvvm23 commented

@pcuenca would be interested in contributing, but not sure what v-prediction is. Could you give me a summary / resources?

kashif commented

thank you for your interest @vvvm23

So v-prediction refers to a type of loss objective in diffusion models. It is somewhat technical but perhaps check Section 4 of "Progressive Distillation for Fast Sampling of Diffusion Models" paper https://arxiv.org/pdf/2202.00512.pdf and let me know if you have further questions...

  • 😄5
patrickvonplaten commented

Closing this one as it's tackled here: #1505