ZYangChen/DC-SatMVS

The official implementation of "Surface Depth Estimation from Multi-view Stereo Satellite Images with Distribution Contrast Network”

DC-SatMVS

The official implementation of "Surface Depth Estimation from Multi-view Stereo Satellite Images with Distribution Contrast Network”
The experimental results are available here, and the full code will be made publicly available upon acceptance.

Model Zoo

Dataset	Code	Weight	Condition
WHU-TLC	available soon	46.7MB	1 * NIVIDA A6000
DTU	available soon	177MB	4 * NIVIDA T4

Due to the large differences in the datasets, we use different data processing methods and different warping methods, which leads to the full version of the code being slightly different when applying our method to the two datasets as above. However, it is important to emphasize that the core design of our code is consistent.

Data Preparation

To evaluate/train this method, you will need to download the required datasets.

• WHU-TLC Please rename the "open_dataset" to "open_dataset_rpc".
• DTU (training data)
• DTU (Depths raw)
• DTU (testing data)

By default dataset_root in train.py, we will search for the datasets in these locations. You can create symbolic links to wherever the datasets were downloaded in the data folder

├── data
    ├── TLC
        ├── Open
        ├── open_dataset_pinhole
        ├── open_dataset_rpc
    ├── DTU
        ├── mvs_training
            ├── Cameras
            ├── Depths
            ├── Depths_raw
            ├── Rectified
        ├── dtu_test

Environment Preparation

conda create -n CTD python=3.7
conda activate CTD
wget -c https://www.sqlite.org/2021/sqlite-autoconf-3340100.tar.gz
tar -xvf sqlite-autoconf-3340100.tar.gz
cd sqlite-autoconf-3340100
vim sqlite3.c

Add macros under "include"

#define SQLITE_CORE 1
#define SQLITE_AMALGAMATION 1
#ifndef SQLITE_PRIVATE
# define SQLITE_PRIVATE static
#endif
#define SQLITE_ENABLE_COLUMN_METADATA 1        //Please pay attention to this line
 
/************** Begin file ctime.c *******************************************/
/*

recompile

./configure
make
sudo make uninstall
sudo make install
#Verify that the installation was successful
sqlite3 --version

Download proj (version 6.3.2) source code, unzip it and compile and install it

proj-5.2.0
wget https://download.osgeo.org/proj/proj-6.3.2.tar.gz
tar -zxvf proj-6.3.2.tar.gz
#Go to the directory and compile
cd proj-6.3.2
./configure
make
make install
ldconfig
proj --version

Download geos (version 3.8.1), unzip it, compile and install it.

wget http://download.osgeo.org/geos/geos-3.8.1.tar.bz2
tar -jxvf geos-3.8.1.tar.bz2
cd geos-3.8.1
./configure
make
make install 
ldconfig
geos-config --version

gdal(2.4.2)

pip install setuptools==57.5.0
sudo add-apt-repository ppa:ubuntugis && sudo apt update
sudo apt install gdal-bin
gdalinfo --version  # 假设输出为2.4.2

pip install gdal==2.4.2.*

or

wget -c http://download.osgeo.org/gdal/2.4.2/gdal-2.4.2.tar.gz
tar -zxvf gdal-2.4.2.tar.gz
cd /gdal-2.4.2/swig/python/
python setup.py build
python setup.py install

python
from osgeo import gdal

pip install torch==1.7.1+cu110 torchvision==0.8.2+cu110 torchaudio==0.7.2 -f https://download.pytorch.org/whl/torch_stable.html
pip install tensorboardX
pip install matplotlib
pip install opencv-python
pip install imageio