UE5.1 incorrect estimation optical flow in dy direction
Closed this issue · 4 comments
hi, I find the optical flow is incorrect when camera move in dy without dx.
in this example optical is correct , camera forward or backward . But move up or down is incorrect.
thank you , looking forward your reply.
Hi @zhangjialu11,
Did you mean to provide an example projects or some images of the issue?
I will try to reproduce it, but I'm not aware of the issue.
okk~ thank you reply
in this example is correct:
camera is forward or backward or rotation Z axis (UE coordinate)
img0:
img1:
warp0:
I found in this example is incorrect:
camera rotation Y axis (UE coordinate). img0 to img1 is move upward, but warp0 is downward
img0:
img1:
warp0:
I use the same code to test warp.
I try to solve this problem, but no successful.
I think it's possible that this is caused by the fact that the camera coordinate system of the UE is different from the camera coordinate system in the ideal pinhole camera model. In UE the camera coordinate system is the same as the world coordinate system, but this is not the case for the ideal pinhole camera model
hi~, I've solved the problem, thanks for the reply!
hi~, I've solved the problem, thanks for the reply!
@NikolaJov96 @ghost hi,I also encountered this problem. Can you share your solution? Thank you very much.