/Super-Resolution.Benckmark

Benchmark and resources for single super-resolution algorithms

Super-Resolution.Benckmark

A curated list of super-resolution resources and a benchmark for single image super-resolution algorithms.

See my implementated super-resolution algorithms:

TODO

Build a benckmark like SelfExSR_Code

State-of-the-art algorithms

Classical Sparse Coding Method

  • ScSR [Web]
  • Image super-resolution as sparse representation of raw image patches (CVPR2008), Jianchao Yang et al.
  • Image super-resolution via sparse representation (TIP2010), Jianchao Yang et al.
  • Coupled dictionary training for image super-resolution (TIP2011), Jianchao Yang et al.

Anchored Neighborhood Regression Method

  • ANR [Web]
  • Anchored Neighborhood Regression for Fast Example-Based Super-Resolution (ICCV2013), Radu Timofte et al.
  • A+ [Web]
  • A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution (ACCV2014), Radu Timofte et al.
  • IA [Web]
  • Seven ways to improve example-based single image super resolution (CVPR2016), Radu Timofte et al.

Self-Exemplars

  • SelfExSR [Web]
  • Single Image Super-Resolution from Transformed Self-Exemplars (CVPR2015), Jia-Bin Huang et al.

Bayes

  • NBSRF [Web]
  • Naive Bayes Super-Resolution Forest (ICCV2015), Jordi Salvador et al.

Deep Learning Method

  • SRCNN [Web] [waifu2x by nagadomi]
  • Image Super-Resolution Using Deep Convolutional Networks (ECCV2014), Chao Dong et al.
  • Image Super-Resolution Using Deep Convolutional Networks (TPAMI2015), Chao Dong et al.
  • CSCN [Web]
  • Deep Networks for Image Super-Resolution with Sparse Prior (ICCV2015), Zhaowen Wang et al.
  • Robust Single Image Super-Resolution via Deep Networks with Sparse Prior (TIP2016), Ding Liu et al.
  • VDSR [Web] [Unofficial Implementation in Caffe]
  • Accurate Image Super-Resolution Using Very Deep Convolutional Networks (CVPR2016), Jiwon Kim et al.
  • DRCN [Web]
  • Deeply-Recursive Convolutional Network for Image Super-Resolution (CVPR2016), Jiwon Kim et al.
  • ESPCN [PDF]
  • Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network (CVPR2016), Wenzhe Shi et al.
  • Is the deconvolution layer the same as a convolutional layer? [PDF]
  • Checkerboard artifact free sub-pixel convolution [PDF]
  • FSRCNN [Web]
  • Acclerating the Super-Resolution Convolutional Neural Network (ECCV2016), Dong Chao et al.
  • LapSRN [Web]
  • Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution (CVPR 2017), Wei-Sheng Lai et al.
  • EDSR [PDF]
  • Enhanced Deep Residual Networks for Single Image Super-Resolution (Winner of NTIRE2017 Super-Resolution Challenge), Bee Lim et al.

Perceptual Loss and GAN

  • Perceptual Loss [PDF]
  • Perceptual Losses for Real-Time Style Transfer and Super-Resolution (ECCV2016), Justin Johnson et al.
  • SRGAN [PDF]
  • Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network (CVPR2017), Christian Ledig et al.
  • AffGAN [PDF]
  • AMORTISED MAP INFERENCE FOR IMAGE SUPER-RESOLUTION (ICLR2017), Casper Kaae Sønderby et al.
  • EnhanceNet [PDF]
  • EnhanceNet: Single Image Super-Resolution through Automated Texture Synthesis, Mehdi S. M. Sajjadi et al.
  • neural-enchance [Github]

Video SR

  • VESPCN [PDF]
  • Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensation (CVPR2017), Jose Caballero et al.

Dicussion

Deconvolution and Sub-Pixel Convolution

Datasets

Test Dataset Image source
Set 5 Bevilacqua et al. BMVC 2012
Set 14 Zeyde et al. LNCS 2010
BSD 100 Martin et al. ICCV 2001
Urban 100 Huang et al. CVPR 2015
Train Dataset Image source
Yang 91 Yang et al. CVPR 2008
BSD 200 Martin et al. ICCV 2001
General 100 Dong et al. ECCV 2016
ImageNet Olga Russakovsky et al. IJCV 2015
COCO Tsung-Yi Lin et al. ECCV 2014

Quantitative comparisons

Results from papers of VDSR, DRCN, CSCN and IA.

Note: IA use enchanced prediction trick to improve result.

Results on Set 5
Scale Bicubic A+ SRCNN SelfExSR CSCN VDSR DRCN IA
2x - PSNR/SSIM 33.66/0.9929 36.54/0.9544 36.66/0.9542 36.49/0.9537 36.93/0.9552 37.53/0.9587 37.63/0.9588 37.39/
3x - PSNR/SSIM 30.39/0.8682 32.59/0.9088 32.75/0.9090 32.58/0.9093 33.10/0.9144 33.66/0.9213 33.82/0.9226 33.46/
4x - PSNR/SSIM 28.42/0.8104 30.28/0.8603 30.48/0.8628 30.31/0.8619 30.86/0.8732 31.35/0.8838 31.53/0.8854 31.10/
Results on Set 14
Scale Bicubic A+ SRCNN SelfExSR CSCN VDSR DRCN IA
2x - PSNR/SSIM 30.24/0.8688 32.28/0.9056 32.42/0.9063 32.22/0.9034 32.56/0.9074 33.03/0.9124 33.04/0.9118 32.87/
3x - PSNR/SSIM 27.55/0.7742 29.13/0.8188 29.28/0.8209 29.16/0.8196 29.41/0.8238 29.77/0.8314 29.76/0.8311 29.69/
4x - PSNR/SSIM 26.00/0.7027 27.32/0.7491 27.49/0.7503 27.40/0.7518 27.64/0.7587 28.01/0.7674 28.02/0.7670 27.88/
Results on BSD 100
Scale Bicubic A+ SRCNN SelfExSR CSCN VDSR DRCN IA
2x - PSNR/SSIM 29.56/0.8431 31.21/0.8863 31.36/0.8879 31.18/0.8855 31.40/0.8884 31.90/0.8960 31.85/0.8942 31.79/
3x - PSNR/SSIM 27.21/0.7385 28.29/0.7835 28.41/0.7863 28.29/0.7840 28.50/0.7885 28.82/0.7976 28.80/0.7963 28.76/
4x - PSNR/SSIM 25.96/0.6675 26.82/0.7087 26.90/0.7101 26.84/0.7106 27.03/0.7161 27.29/0.7251 27.23/0.7233 27.25/