NAN outputs resulting in a blank video

Question

NAN outputs resulting in a blank video

rakesh-reddy95 opened this issue a year ago · 4 comments

@omerbt I have run tokenflow using pnp but the results are blank and the decoded latents are NaN. While the inversion during the preprocess happened correctly.

Answer 1 · 2023-11-27T02:16:06.000Z

Same here. Any idea about it?

Answer 2 · 2023-11-29T06:23:31.000Z

Which version of SD are you using?

Answer 3 · 2023-11-29T07:08:27.000Z

Which version of SD are you using?

I was using SD1.5.
I find that several frames get NAN outputs after DDIM Inversion and reconstruction, therefore leads to the following NAN outputs in editing stage.
Not sure the reason for it.

Answer 4 · 2023-11-29T07:13:03.000Z

I started using SD 2.1 base version which didn't produce NaN in DDIM inversion and reconstruction. Also, you can try calculating the next step velocity along with the previous step velocity which was removing NaN.