Image Denoising State-of-the-art

A curated list of image denoising resources and a benchmark for image denoising approaches.

This list is maintained by: Wenhan Yang [STRUCT] PKU (PI: Prof. Jiaying Liu)

State-of-the-art algorithms

Filter

  • BM3D [Web] [Code] [PDF]
    • Image restoration by sparse 3D transform-domain collaborative filtering (SPIE Electronic Imaging 2008), Dabov et al.
  • Activity-tuned Image Filtering [PDF]
    • Local Activity-tuned Image Filtering for Noise Removal and Image Smoothing (Arxiv 2017), Lijun Zhao, Jie Liang, Huihui Bai, Lili Meng, Anhong Wang, and Yao Zhao.

Sparse Coding

  • KSVD [Web] [Code] [PDF]
    • Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries (TIP2006), Elad et al.
  • SAINT [Web] [Code] [PDF]
    • Nonlocal image restoration with bilateral variance estimation: a low-rank approach (TIP2013), Dong et al.
  • NCSR [Web] [Code] [PDF]
    • Nonlocally Centralized Sparse Representation for Image Restoration (TIP2012), Dong et al.
  • LSSC [Web] [Code] [PDF]
    • Non-local Sparse Models for Image Restoration (ICCV2009), Mairal et al.

Effective Prior

  • EPLL [Web] [Code] [PDF]
    • From Learning Models of Natural Image Patches to Whole Image Restoration (ICCV2011), Zoran et al.
  • Bayesian Hyperprior [PDF]
    • A Bayesian Hyperprior Approach for Joint Image Denoising and Interpolation with an Application to HDR Imaging, Cecilia Aguerrebere, Andres Almansa, Julie Delon, Yann Gousseau and Pablo Muse.
  • External Prior Guided [PDF]
    • External Prior Guided Internal Prior Learning for Real Noisy Image Denoising, Jun Xu, Lei Zhang, and David Zhang.
  • Multi-Layer Image Representation [PDF]
    • A Multi-Layer Image Representation Using Regularized Residual Quantization: Application to Compression and Denoising, Sohrab Ferdowsi, Slava Voloshynovskiy, Dimche Kostadinov.
  • A Faster Patch Ordering [PDF]
    • A Faster Patch Ordering Method for Image Denoising, Badre Munir.  

Low Rank

  • WNNM [Web] [Code] [PDF]
    • Weighted Nuclear Norm Minimization with Application to Image Denoising (CVPR2014), Gu et al.
  • Multi-channel Weighted Nuclear Norm [PDF]
    • Multi-channel Weighted Nuclear Norm Minimization for Real Color Image Denoising (Arxiv 2017), Jun Xu, Lei Zhang, David Zhang, and Xiangchu Feng.
  • Multi-Scale Weighted Nuclear Norm [PDF]
    • Multi-Scale Weighted Nuclear Norm Image Restoration (CVPR2018), Noam Yair, Tomer Michaeli.

Deep Learning

  • TNRD [Web] [Code] [PDF]
    • Trainable nonlinear reaction diffusion: A flexible framework for fast and effective image restoration (TPAMI2016), Chen et al.
  • DnCNN [Web] [PDF]
    • Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising (TIP2017), Zhang et al.
  • DAAM [Web] [PDF]
    • Deeply Aggregated Alternating Minimization for Image Restoration (Arxiv2016), Youngjung Kim et al.
  • Adversirial Denoising [PDF]
    • Image Denoising via CNNs: An Adversarial Approach (Arxiv2017), Nithish Divakar, R. Venkatesh Babu.
  • Unrolled Optimization Deep Priors [PDF]
    • Unrolled Optimization with Deep Priors (Arxiv2017), Steven Diamond, Vincent Sitzmann, Felix Heide, Gordon Wetzstein.
  • Wider Network [PDF]
    • Going Wider with Convolution for Image Denoising (Arxiv2017), Peng Liu, Ruogu Fang.
  • Recurrent Inference Machines [PDF]
    • Recurrent Inference Machines for Solving Inverse Problems(Arxiv2017), Patrick Putzky, Max Welling.
  • Kernel Prediction [PDF]
    • Burst Denoising With Kernel Prediction Networks (CVPR2018), Ben Mildenhall, Jonathan T. Barron, Jiawen Chen, Dillon Sharlet, Ren Ng, Robert Carroll.
  • GAN-Based Noise Modeling [PDF]
    • Image Blind Denoising With Generative Adversarial Network Based Noise Modeling (CVPR2018), Jingwen Chen, Jiawei Chen, Hongyang Chao, Ming Yang.
  • Universal Denoising Networks [PDF]
    • Universal Denoising Networks : A Novel CNN Architecture for Image Denoising (CVPR2018), Stamatios Lefkimmiatis.
  • Non-Local Recurrent Network [PDF]
    • Non-Local Recurrent Network for Image Restoration (Arxiv2018), Ding Liu, Bihan Wen, Yuchen Fan, Chen Change Loy, Thomas S. Huang.
  • Recurring Patterns Network [PDF]
    • Identifying Recurring Patterns with Deep Neural Networks for Natural Image Denoising (Arxiv2018), Zhihao Xia, Ayan Chakrabarti.
  • Dynamically Unfolding Recurrent Restorer [PDF]
    • Dynamically Unfolding Recurrent Restorer: A Moving Endpoint Control Method for Image Restoration (Arxiv2018), Xiaoshuai Zhang, Yiping Lu, Jiaying Liu, Bin Dong.
  • Pixel Adaptive Image Denoiser [PDF]
    • Fully Convolutional Pixel Adaptive Image Denoiser (Arxiv2018), Sungmin Cha and Taesup Moon.
  • Convolutional Blind Denoising [PDF] [WEB]
    • Toward Convolutional Blind Denoising of Real Photographs (Arxiv2018), Shi Guo, Zifei Yan, Kai Zhang, Wangmeng Zuo, Lei Zhang.
  • Noise2Noise [PDF]
    • Noise2Noise: Learning Image Restoration without Clean Data (ICLR2018), Jaakko Lehtinen, Jacob Munkberg, Jon Hasselgren, Samuli Laine, Tero Karras, Miika Aittala, Timo Aila.

Combined with High-Level Tasks

  • Meets High-level Tasks [PDF]
    • When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach, Ding Liu (IJCAI2018), Bihan Wen, Xianming Liu, Thomas S. Huang.
  • Class-Specific Denoising [PDF]
    • Class-Specific Poisson Denoising By Patch-Based Importance Sampling (Arxiv2017), Milad Niknejad, Jose M. Bioucas-Dias, Mario A. T. Figueiredo.
  • Class-Aware Denoising [PDF]
    • Class-Aware Fully-Convolutional Gaussian and Poisson Denoising (Arxiv2018), Tal Remez, Or Litany, Raja Giryes, and Alex M. Bronstein.
  • Image Denoising + High Level [PDF]
    • Connecting Image Denoising and High-Level Vision Tasks via Deep Learning (Arxiv2018), Ding Liu, Bihan Wen, Jianbo Jiao, Xianming Liu, Zhangyang Wang, and Thomas S. Huang.

Benchmark

  • ReNOIR [PDF] [WEB]
    • RENOIR - A Dataset for Real Low-Light Image Noise Reduction (JVCIR2018), Josue Anaya, Adrian Barbu.
  • Darmsdadt [PDF] [WEB]
    • Benchmarking Denoising Algorithms with Real Photographs (CVPR2017), Tobias Plotz, Stefan Roth.
  • Smartphone Cameras Dataset [PDF]
    • A High-Quality Denoising Dataset for Smartphone Cameras (CVPR2018), Abdelrahman Abdelhamed, Stephen Lin, Michael S. Brown.
  • PolyU [PDF] [WEB]
    • Real-world Noisy Image Denoising: A New Benchmark (Arxiv2018), Jun Xu, Hui Li, Zhetong Liang, David Zhang, and Lei Zhang.