12dmodel/deep_motion_mag

why res_manipulator returns enc_b + diff rather than enc_a + diff?

kkjh0723 opened this issue · 3 comments

In modules.py, I found that res_manipulator returns enc_b + diff rather than enc_a + diff (line 38).
According to the eq. 3 in the paper, isn't the later correct?
I might understand wrong...

Thank you. I understand.

To be very serious, it should only be enc_b + diff.
Suppose we have frame _ A/B/C/M in the given coco dataset, there is color perturbation between A and M. The perturbation was designed as a regularization for extracting motion better, instead of aiming to output an additional perturbation.
And if you check the amplification, enc_b + diff is also the one should be chosen.

link to this confusion.