wenqsun/DimensionX

Question about the number of images generated

BoMingZhao opened this issue · 2 comments

BoMingZhao commented

Thanks for your impressive work!
I used your provide checkpoints to generate a 6 seconds (default settings, 49 frames) video, which is pretty good.
However, when I try to change the num_frames, the results becomes very strange. Actually I tried num_frames=8, 9, 12, 13,41,48, which is all failed.
image

So how to use this parameter?

chenshuo20 commented

CogVideoX-I2V uses 3D RoPE position embeddings, which are fixed, so the number of frames cannot be changed and it only accepts 49 frames at this time. Future versions of CogvideoX may support generation with variable frame lengths. You can find their update here.

BoMingZhao commented

CogVideoX-I2V uses 3D RoPE position embeddings, which are fixed, so the number of frames cannot be changed and it only accepts 49 frames at this time. Future versions of CogvideoX may support generation with variable frame lengths. You can find their update here.

Thanks