/Comparative-Analysis-Building-Extraction-Methods

image segmentation with private İstanbul Dataset

Primary LanguageJupyter Notebook

Comparative Analysis of Deep Learning Based Building Extraction Methods

Our article "Comparative analysis of deep learning based building extraction methods with the new VHR Istanbul dataset" has just been published in the journal of Expert Systems with Applications. My first academic paper is online! (Q1, IF: 6.954)

More than 60 experiments were conducted by applying state-of-the-art architectures such as U-Net, Unet++, DeepLabv3+, FPN and PSPNet with different pre-trained encoders and hyperparameters . Our experiments showed that Unet++ architecture using SE-ResNeXt101 encoder pre-trained with ImageNet provides the best results with 93.8% IoU on the Istanbul dataset.

Article Head

This repo contains weights of Unet++ model with SE-ResNeXt101 encoder trained with our private Istanbul dataset and Inria and Massachusetts datasets seperately. Trainings have been realized using PyTorch and segmentation models library. We also provide an inference notebook to run prediction on GeoTiff images. This notebook also outputs prediction images as GeoTiff.

Sample Images Corresponding Building Labels

Sample images and corresponding building labels from the Istanbul Dataset. Only building boundaries (in red) are shown for better visibility.

Image prediction result with 3 different datasets

Prediction results using network trained with Istanbul (red lines – a, d, g), Inria (blue lines – b, e, h) and Massachhusets (green lines – c, f, i) dataset for sample test images from Istanbul (first row), Inria (middle row) and Massachusetts (last row) dataset.

Our Paper:

Comparative analysis of deep learning-based building extraction methods with the new VHR Istanbul dataset:
This link provides 50 days of free access to the article. Anyone clicking on this link before June 26, 2022, will be taken directly to the final version of your article on ScienceDirect, which they are welcome to read or download.

Also, you can reach my Medium article about this repo.

Weights Files

You can use the following links to download weights files:
  • Unet++ trained with Istanbul Dataset: Download
  • Unet++ trained with Inria Dataset: Download
  • Unet++ trained with Massachusetts Dataset: Download
  • Unet++ with InceptionResNetv2 encoder: Download
  • Unet++ with EfficientNet-b6 encoder: Download
  • UNet with SE-ResNeXt101 encoder: Download
  • UNet with InceptionResNetv2 encoder: Download
  • UNet with EfficientNet-b6 encoder: Download
  • DeepLabv3+ with SE-ResNeXt101 encoder:Download

Stack and Requirements

To run the notebook, following libraries are required:
  • torch == 1.7.1
  • segmentation-models-pytorch == 0.1.3
  • scikit-image = 0.18.1
  • GDAL == 3.2.1
  • tifffile == 2021.2.1