Improving Structure from Motion with Reliable Resectioning

Authors: Rajbir Kataria, Joseph DeGol, Derek Hoiem

Paper
Supplementary Material
Poster
Short Video
Presentation

Abstract

A common cause of failure in structure-from-motion (SfM) is misregistration of images due to visual patterns that occur in more than one scene location. Most work to solve this problem ignores image matches that are inconsistent according to the statistics of the tracks graph, but these methods often need to be tuned for each dataset and can lead to reduced completeness of normally good reconstructions when valid matches are removed. Our key idea is to address ambiguity directly in the reconstruction process by using only a subset of reliable matches to determine resectioning order and the initial pose. We also introduce a new measure of similarity that adjusts the influence of feature matches based on their track length. We show this improves reconstruction robustness for two state-of-the-art SfM algorithms on many diverse datasets.

Getting Started

Clone Repository: git clone --branch raj.reliable-resectioning git@github.com:rajkataria/ReliableResectioning.git

OpenSfM

  1. Follow install instructions at https://www.opensfm.org/docs/building.html

COLMAP

  1. Follow installation instructions at https://colmap.github.io/install.html
  2. Install libjsconcpp library: sudo apt-get install libjsoncpp-dev

Contact

If you have any questions, please contact Rajbir Kataria