wenqsun/DimensionX

how to distinguish whether the generated video is 2D or 4D？

Opened this issue · 7 comments

Fancy93 commented

Very interesting work. I have a question: how to distinguish whether the generated video is 2D or 4D in the paper?

wenqsun commented

Thanks for your interest! In our paper, Fig. 4 shows the spatial- and temporal-variant videos, Fig. 5 shows the 3dgs renderings of spatial-variant videos, and Fig. 6 presents the novel-view videos of 4D scenes.

Is it clear now? Welcome to ask us if you have any questions.

Fancy93 commented

Thanks for your kind reply, I have another question, is the input video 2D or 4D?
1731659551392

wenqsun commented

Hi, the input view video means the 4D scene video from the input view.

I should use clearer expression to emphasize the results in the paper. Thanks for your question.

wenqsun commented

I want to talk more about the input view video in Fig. 6. For the first row, we use the real-world video as the input view (front view) video and generate the 4D scene with our controllable video generation, which is used to generate the novel view videos below.

Fancy93 commented

Oh, I see. You want to generate a scene with three perspectives, not a video, right?

wenqsun commented

Actually, we use not just three-view videos, but dozens of multi-view videos to reconstruct this 4D scene. In our paper, we only present 3 views.

Fancy93 commented

so，How to distinguish whether the generated video is 2D or 4D？