/cnn-rgbir

Siamese CNNs for RGB-LWIR Disparity Estimation (CVPRW 2019)

Primary LanguageCMakeMIT LicenseMIT

Siamese CNNs for RGB-LWIR Disparity Estimation

This repository contains all the code to reproduce the experiments in our paper Siamese CNNs for RGB-LWIR Disparity Estimation. It is separated into three modules.

  • Patch Generator: Generates the disparity locations (center of patches) for training, validation and testing set.
  • Rectification: Rectifies images of the St-Charles dataset.
  • Stereo: Generates dataset based on the chosen fold and contains scripts to train and test the model.
  • Shared: Contains configuration file which all modules use.

Citation

@InProceedings{Beaupre_2019_CVPR_Workshops,
author = {Beaupre, David-Alexandre and Bilodeau, Guillaume-Alexandre},
title = {Siamese CNNs for RGB-LWIR Disparity Estimation},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops},
month = {June},
year = {2019}
}

Usage

Please refer to README files in each module for more details. Make sure to change paths and other variables in the config file to your own values.

Steps

  1. Rectify the images from the St-Charles dataset with the Rectification module.
  2. Generate the dataset from the dataset.py script in the stereo module.
  3. Generate patch locations with the Patch Generator module.
  4. Train or test the model with the scripts in the Stereo module.

Datasets

Simply put both datasets in a folder named "litiv" where all your datasets are located.

Contact

For any comments, questions or concerns, feel free to contact me at david-alexandre.beaupre@polymtl.ca

License

See the LICENSE file for more details.