Optical flow estimation

[Wyatt299]

Could you please provide a demo of optical flow estimation？Thank you.

[jiangwei221]

Hey Wyatt, we obtain the optical flow/dense correspondence map by interpolating the sparse correspondences, as shown here:

COTR/demo_single_pair.py

Line 42 in 5c9363f

dense = triangulate_corr(corrs, img_a.shape, img_b.shape)

.
The interpolated optical flow/dense correspondence has a smaller area than the GT, that's because the our filtering strategy will prune out some untrustworthy points around borders.
As for how to select query points, 1. randomly select, 2. select points with GT flow(KITTI).

[Wyatt299]

Great answer, thanks a lot, hope to post a demo on optical flow estimation later.