/awesome-low-light-image-enhancement

This is a resouce list for low light image enhancement

Primary LanguageMATLAB

Awesome Low Light Image Enhancement

This is a resource list for low light image enhancement, including datasets, methods/codes/papers, metrics, blogs and so on.

Maintained by: Zhihong Zhang

Looking forward to your sharing! You can come up with your ideas and suggestions in the issue

Introduction

Low light imaging and low light image enhancement have wild applications in our daily life and different scientific research fields, like night surveillance, automated driving, fluorescence microscopy, high speed imaging and so on. However, there is still a long way to go in dealing with these tasks, considering the great challenges in low photon counts, low SNR, complicated noise models, etc. Here, we collect a list of resources related to low light image enhancement, including datasets, methods/codes/papers, metrics, and so on. We hope this can help to provide some help to the development of new methods and solutions to the low light tasks.

Table of Contents

Highlights

🔆 News!

  • Papers from ICCV2021 have been updated! Four new datasets from ICCV2021 are added!
  • A new review article "Low-Light Image and Video Enhancement Using Deep Learning: A Survey" from TPAMI have been added!

Datasets

dataset brief introduction link
VIP-LowLight Eight Natural Images Captured in Very Low-Light Conditions https://uwaterloo.ca/vision-image-processing-lab/research-demos/vip-lowlight-dataset
ReNOIR RENOIR - A Dataset for Real Low-Light Image Noise Reduction http://ani.stat.fsu.edu/~abarbu/Renoir.html
Raw Image Low-Light Object - https://wiki.qut.edu.au/display/cyphy/Datasets
SID Learning to see in the dark;
light level (outdoor scene 0.2 lux - 5 lux; indoor scene: 0.03 lux - 0.3 lux)		 http://vladlen.info/publications/learning-see-dark （including codes）
ExDARK Getting to Know Low-light Images with The Exclusively Dark Dataset https://github.com/cs-chan/Exclusively-Dark-Image-Dataset （including codes）
MIT-Adobe FiveK Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs
(with ~4% low light images)		 https://data.csail.mit.edu/graphics/fivek
LRAICE-Dataset A Learning-to-Rank Approach for Image Color Enhancement -
The 500px Dataset Exposure: A White-Box Photo Post-Processing Framework -
DPED DSLR-quality photos on mobile devices with deep convolutional networks http://people.ee.ethz.ch/~ihnatova
LOL Deep Retinex Decomposition for Low-Light Enhancement https://daooshee.github.io/BMVC2018website
VV - most challenging cases Busting image enhancement and tone-mapping algorithms: A collection of the most challenging cases
from Vassilios Vonikakis		 https://sites.google.com/site/vonikakis/datasets/challenging-dataset-for-enhancement
VV - Phos A color image database of 15 scenes captured under different illumination conditions
from Vassilios Vonikakis		 http://robotics.pme.duth.gr/phos2.html
SICE A large-scale multi-exposure image dataset, which contains 589 elaborately selected high-resolution multi-exposure sequences with 4,413 images https://github.com/csjcai/SICE
The Extended Yale Face Database B The extended Yale Face Database B contains 16128 images of 28 human subjects under 9 poses and 64 illumination conditions. http://vision.ucsd.edu/~iskwak/ExtYaleDatabase/ExtYaleB.html
the nighttime image dataset A dataset which contains source images in bad visibility and their enhanced images processed by different enhancement algorithms http://mlg.idm.pku.edu.cn/
VE-LOL A large-scale low-light image dataset serving both low/high-level vision with diversified scenes and contents as well as complex degradation in real scenarios, called Vision Enhancement in the LOw-Light condition (VE-LOL).
SDSD dataset Seeing Dynamic Scene in the Dark: High-Quality Video Dataset with Mechatronic Alignment https://github.com/dvlab-research/SDSD
MID Matching in the Dark: A Dataset for Matching Image Pairs of Low-light Scenes https://wenzhengchina.github.io/projects/mid/
DeepHDRVideo-Dataset HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset https://guanyingc.github.io/DeepHDRVideo-Dataset/
LLVIP LLVIP: A visible-infrared paired dataset for low-light vision https://bupt-ai-cz.github.io/LLVIP/
RELLISUR RELLISUR: A Real Low-Light Image Super-Resolution Dataset https://vap.aau.dk/rellisur/

Methods

HE-based methods

  • HE [Code]
  • CLAHE [Pdf]
    • S.M. Pizer, and R. E. Johnston, “Contrast limited adaptive histogram equalization: speed and effectiveness,”IEEE Transl. on Consumer Electronics,1990
  • BPDHE [Code] [Pdf]
    • H. Ibrahim and N. S. Pik Kong, "Brightness Preserving Dynamic Histogram Equalization for Image Contrast Enhancement," in IEEE Transactions on Consumer Electronics, vol. 53, no. 4, pp. 1752-1758, Nov. 2007
  • DHE [Pdf]
    • Abdullah-Al-Wadud M , Kabir M H , Dewan M A A , et al. A Dynamic Histogram Equalization for Image Contrast Enhancement[J]. IEEE Transactions on Consumer Electronics, 2007, 53(2):p.593-600.
  • WTHE [Pdf]
    • Q. Wang and R. K. Ward, "Fast Image/Video Contrast Enhancement Based on Weighted Thresholded Histogram Equalization," in IEEE Transactions on Consumer Electronics, vol. 53, no. 2, pp. 757-764, May 2007
  • CVC [Pdf]
    • T. Celik and T. Tjahjadi, "Contextual and Variational Contrast Enhancement," in IEEE Transactions on Image Processing, vol. 20, no. 12, pp. 3431-3441, Dec. 2011
  • LDR [Web]
    • Chulwoo Lee, Chul Lee, and Chang-Su Kim, “Contrast enhancement based on layered difference representation,” in Proc. International Conference on Image Processing (ICIP), Orlando, USA, pp. 965-968, Sept.-Oct. 2012. [doi] [pdf] [pptx]
    • Chulwoo Lee, Chul Lee, and Chang-Su Kim, “Contrast enhancement based on layered difference representation of 2D histograms,” IEEE Transactions on Image Processing, vol. 22, no. 12, pp. 5372-5384, Dec. 2013. [doi] [pdf]
  • POHE [Pdf]
    • Liu, Y.F., Guo, J.M., Lai, B.S. and Lee, J.D., "High efficient contrast enhancement using parametric approximation," In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing
  • See also: link

Retinex-based methods

🔖 retinex

  • SSR [Pdf]
    • D. J. Jobson, Z. Rahman and G. A. Woodell, "Properties and performance of a center/surround retinex," in IEEE Transactions on Image Processing, vol. 6, no. 3, pp. 451-462, March 1997
  • MSR [Code]
  • MSRCR [Code1] [Code2] [Pdf]
    • Z. Rahman, D. J. Jobson and G. A. Woodell, "Multi-scale retinex for color image enhancement," Proceedings of 3rd IEEE International Conference on Image Processing, Lausanne, Switzerland, 1996
    • D. J. Jobson, Z. Rahman and G. A. Woodell, "A multiscale retinex for bridging the gap between color images and the human observation of scenes," in IEEE Transactions on Image Processing, vol. 6, no. 7, pp. 965-976, July 1997
  • AMSR [Code] [Pdf]
    • C. Lee, J. Shih, C. Lien and C. Han, "Adaptive Multiscale Retinex for Image Contrast Enhancement," in 2013 International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), Kyoto, Japan, 2013
  • NPE [Web] [Code1] [Code2] [Pdf]
    • S. Wang, J. Zheng, H. Hu and B. Li, "Naturalness Preserved Enhancement Algorithm for Non-Uniform Illumination Images," in IEEE Transactions on Image Processing, vol. 22, no. 9, pp. 3538-3548, Sept. 2013
  • SRIE [Pdf_1] [Pdf_2] [Code_1] [Code_2]
    • X. Fu, Y. Liao, D. Zeng, Y. Huang, X. Zhang and X. Ding, "A Probabilistic Method for Image Enhancement With Simultaneous Illumination and Reflectance Estimation," in IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 4965-4977, Dec. 2015
    • X. Fu, D. Zeng, Y. Huang, X.-P. Zhang, and X. Ding, “A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, Jun. 2016
  • LIME [Web] [Code_official] [Code1] [Code2] [Code3] [Pdf] [Report]
    • X. Guo, “LIME: A Method for Low-light IMage Enhancement,” in Proceedings of the 2016 ACM on Multimedia Conference - MM ’16, Amsterdam, The Netherlands, 2016
    • X. Guo, Y. Li, and H. Ling, “LIME: Low-Light Image Enhancement via Illumination Map Estimation,” IEEE Trans. on Image Process., vol. 26, no. 2, pp. 982–993, Feb. 2017
  • MF (Multi-deviation Fusion method) [Code] [Pdf]
    • X. Fu, D. Zeng, Y. Huang, Y. Liao, X. Ding, and J. Paisley, “A fusion-based enhancing method for weakly illuminated images,” Signal Processing, vol. 129, pp. 82–96, Dec. 2016
  • JieP [Web] [Code] [Pdf]
    • B. Cai, X. Xu, K. Guo, K. Jia, B. Hu, and D. Tao, “A Joint Intrinsic-Extrinsic Prior Model for Retinex,” in IEEE International Conference on Computer Vision (ICCV), 2017.
  • Robust Retinex Model [Code1] [Code2] [Pdf]
    • M. Li, J. Liu, W. Yang, X. Sun, and Z. Guo, “Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model,” IEEE Trans. on Image Process., vol. 27, no. 6, pp. 2828–2841, Jun. 2018
  • A Smart System for Low-Light Image Enhancement with Color Constancy and Detail Manipulation in Complex Light Environments [Pdf]
    • Z. Rahman, M. Aamir, Y.-F. Pu, F. Ullah, and Q. Dai, “A Smart System for Low-Light Image Enhancement with Color Constancy and Detail Manipulation in Complex Light Environments,” Symmetry, vol. 10, no. 12, p. 718, Dec. 2018
  • Fractional-Order Fusion Model for Low-Light Image Enhancement [Pdf]
    • Q. Dai, Y.-F. Pu, Z. Rahman, and M. Aamir, “Fractional-Order Fusion Model for Low-Light Image Enhancement,” Symmetry, vol. 11, no. 4, p. 574, Apr. 2019
  • Hybrid L2 −LP Variational Model [Pdf]
    • G. Fu, L. Duan and C. Xiao, "A Hybrid L2 −LP Variational Model For Single Low-Light Image Enhancement With Bright Channel Prior," 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 2019
  • NIPM [Pdf]
    • Y. Wu, J. Zheng, W. Song and F. Liu, "Low light image enhancement based on non-uniform illumination prior model," in IET Image Processing, vol. 13, no. 13, pp. 2448-2456, 14 11 2019
  • Dual Illumination Estimation for Robust Exposure Correction [Pdf] [Code1]
    • Qing Zhang, Yongwei Nie, and Wei-Shi Zheng. Dual illumination estimation for robust exposure correction. In Computer Graphics Forum, 2019
  • NPLIE [Pdf]
    • D. A. S. Parihar and K. Singh, “Illumination Estimation for Nature Preserving low-light image enhancement,” May 2020
  • A comparative analysis of illumination estimation based Image Enhancement techniques [Pdf]
  • K. Singh and A. S. Parihar, "A comparative analysis of illumination estimation based Image Enhancement techniques," 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), Vellore, India, 2020
  • LR3M [Pdf]
    • X. Ren, W. Yang, W. Cheng and J. Liu, "LR3M: Robust Low-Light Enhancement via Low-Rank Regularized Retinex Model," in IEEE Transactions on Image Processing, vol. 29, pp. 5862-5876, 2020

CRM&fusion-based methods (Camera Respond Model)

  • A New Low-Light Image Enhancement Algorithm Using Camera Response Model [Code] [Pdf]
    • Z.Ying, G. Li, Y. Ren, R. Wang and W. Wang, "A New Low-Light Image Enhancement Algorithm Using Camera Response Model," 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, 2017
  • BIMEF [Code] [Pdf]
    • Z.Ying, G. Li, and W. Gao, “A Bio-Inspired Multi-Exposure Fusion Framework for Low-light Image Enhancement,” arXiv:1711.00591 [cs], Nov. 2017
  • Exposure Fusion Framework [Web] [Code_matlab] [Code_python] [Pdf]
    • Z.Ying, G. Li, Y. Ren, R. Wang, and W. Wang, “A New Image Contrast Enhancement Algorithm Using Exposure Fusion Framework,” in International Conference on Computer Analysis of Images and Patterns, 2017, pp. 36–46.

Learning-based methods

  • MSR-net [Pdf]
    • L. Shen, Z. Yue, F. Feng, Q. Chen, S. Liu, and J. Ma, “MSR-net:Low-light Image Enhancement Using Deep Convolutional Network,” arXiv:1711.02488 [cs], Nov. 2017
  • Deep Burst Denoising [Pdf]
    • C. Godard, K. Matzen, and M. Uyttendaele, “Deep Burst Denoising,” arXiv:1712.05790 [cs, stat], Dec. 2017
  • LLCNN [Pdf]
    • L. Tao, C. Zhu, G. Xiang, Y. Li, H. Jia and X. Xie, "LLCNN: A convolutional neural network for low-light image enhancement," 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, 2017
    • dataset
  • LLNet [Pdf]
    • K. G. Lore, Adedotun Akintayo, and S. Sarkar, “LLNet: A deep autoencoder approach to natural low-light image enhancement,” Pattern Recognition, vol. 61, pp. 650–662, Jan. 2017
  • HDRNet [Web] [Code] [Pdf]
    • M. Gharbi, J. Chen, J. T. Barron, S. W. Hasinoff, and F. Durand, “Deep bilateral learning for real-time image enhancement,” ACM Trans. Graph., vol. 36, no. 4, pp. 1–12, Jul. 2017
  • DSLR Quality Photos on Mobile Devices with Deep Convolutional Networks [Pdf]
    • A. Ignatov, N. Kobyshev, R. Timofte and K. Vanhoey, "DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks," 2017 IEEE International Conference on Computer Vision (ICCV), Venice, 2017
  • Retinex-Net [Web] [Code] [Pdf]
    • C. Wei, W. Wang, W. Yang, and J. Liu,"Deep Retinex Decomposition for Low-Light Enhancement." BMVC 2018, Oral Presentation.
    • 🔖 retinex
  • MBLLEN [Web] [Code] [Pdf]
    • F. Lv, “MBLLEN: Low-light Image/Video Enhancement Using CNNs,” presented at the British Machine Vision Conference, 2018, p. 13.
  • LightenNet [Pdf]
    • C. Li, J. Guo, F. Porikli, and Y. Pang, “LightenNet: A Convolutional Neural Network for weakly illuminated image enhancement,” Pattern Recognition Letters, vol. 104, pp. 15–22, Mar. 2018
    • 🔖 retinex
  • Learning to See in the Dark [Web] [Code] [Pdf]
    • C. Chen, Q. Chen, J. Xu, and V. Koltun, “Learning to See in the Dark,” CVPR 2018, May 2018
    • real dataset
  • SICE [Code] [Pdf]
    • J. Cai, S. Gu, and Z. Lei, “Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images,” IEEE Transactions on Image Processing, vol. 27, no. 4, pp. 2049–2062, 2018
  • White-Box [Code] [Pdf]
    • Y. Hu, H. He, C. Xu, B. Wang, and S. Lin, “Exposure: A White-Box Photo Post-Processing Framework,” ACM Trans. Graph., vol. 37, no. 2, pp. 1–17, Jul. 2018, doi: 10.1145/3181974.
  • GLADNet [Web] [Code] [Pdf]
    • W. Wang, C. Wei, W. Yang and J. Liu, "GLADNet: Low-Light Enhancement Network with Global Awareness," 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition
    • synthetic dataset generated from RAW images
  • A Pipeline Neural Network for Low-Light Image Enhancement [Pdf]
    • Y. Guo, X. Ke, J. Ma, and J. Zhang, “A Pipeline Neural Network for Low-Light Image Enhancement,” IEEE Access, vol. 7, pp. 13737–13744, 2019
  • KinD [Code] [Code+] [Pdf]
    • Y. Zhang, J. Zhang, and X. Guo,, “Kindling the Darkness: A Practical Low-light Image Enhancer,” arXiv:1905.04161 [cs], May 2019
  • Learning Digital Camera Pipeline for Extreme Low-Light Imaging [Pdf]
    • S. Waqas Zamir, A. Arora, S. Khan, F. Shahbaz Khan, and L. Shao, “Learning Digital Camera Pipeline for Extreme Low-Light Imaging,” arXiv preprint arXiv:1904.05939, 2019.
  • End-to-End Denoising of Dark Burst Images Using Recurrent Fully Convolutional Networks [Pdf]
    • D. Zhao, L. Ma, S. Li, and D. Yu, “End-to-End Denoising of Dark Burst Images Using Recurrent Fully Convolutional Networks,” arXiv:1904.07483 [cs], Apr. 2019
  • A Bit Too Much [Pdf]
    • P. Chandramouli, Claudio Bruschini, and and A. Kolb, “A Bit Too Much? High Speed Imaging from Sparse Photon Counts,” in 2019 IEEE International Conference on Computational Photography (ICCP), Tokyo, Japan, May 2019
  • DeepISP [Pdf]
    • E. Schwartz, R. Giryes, and A. M. Bronstein, “DeepISP: Towards Learning an End-to-End Image Processing Pipeline,” IEEE Trans. on Image Process., vol. 28, no. 2, pp. 912–923, Feb. 2019
  • DeepUPE [Code] [Pdf]
    • R. Wang, Q. Zhang, C. Fu, X. Shen, W. Zheng and J. Jia, "Underexposed Photo Enhancement Using Deep Illumination Estimation," 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2019
    • 🔖 retinex
  • Low-Light Image Enhancement via a Deep Hybrid Network [Pdf]
    • W. Ren et al., "Low-Light Image Enhancement via a Deep Hybrid Network," in IEEE Transactions on Image Processing, vol. 28, no. 9, pp. 4364-4375, Sept. 2019
  • RDGAN [Code] [Pdf]
    • J. Wang, W. Tan, X. Niu and B. Yan, "RDGAN: Retinex Decomposition Based Adversarial Learning for Low-Light Enhancement," 2019 IEEE International Conference on Multimedia and Expo (ICME), Shanghai, China, 2019
    • 🔖 retinex
  • Deep Fusion Networks [Pdf]
    • Y. Cheng, J. Yan and Z. Wang, "Enhancement of Weakly Illuminated Images by Deep Fusion Networks," 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 2019
  • Llrnet [Pdf]
    • S. Malik and R. Soundararajan, "Llrnet: A Multiscale Subband Learning Approach for Low Light Image Restoration," 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 2019
  • Low-Lightgan [Pdf]
    • G. Kim, D. Kwon and J. Kwon, "Low-Lightgan: Low-Light Enhancement Via Advanced Generative Adversarial Network With Task-Driven Training," 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 2019
  • EnlightenGAN [Code] [Pdf]
    • Y. Jiang et al., “EnlightenGAN: Deep Light Enhancement without Paired Supervision,” arXiv:1906.06972 [cs, eess], Jun. 2019
  • An Effective Network with ConvLSTM for Low-Light Image Enhancement [Pdf]
    • Y. Xiang, Y. Fu, L. Zhang, and H. Huang, “An Effective Network with ConvLSTM for Low-Light Image Enhancement,” in Pattern Recognition and Computer Vision, Cham, 2019.
  • Enhancing Low Light Videos by Exploring High Sensitivity Camera Noise [Pdf]
    • W. Wang, X. Chen, C. Yang, X. Li, X. Hu and T. Yue, "Enhancing Low Light Videos by Exploring High Sensitivity Camera Noise," 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 2019, pp. 4110-4118, doi: 10.1109/ICCV.2019.00421.
  • Low-Light Image Enhancement with Attention and Multi-level Feature Fusion [Pdf]
    • L. Wang, G. Fu, Z. Jiang, G. Ju and A. Men, "Low-Light Image Enhancement with Attention and Multi-level Feature Fusion," 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Shanghai, China, 2019
  • Zero-DCE [Web] [Code] [Pdf]
    • C. Guo et al., “Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement,” in 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, Jun. 2020, pp. 1777–1786, doi: 10.1109/CVPR42600.2020.00185.
  • Learning to Restore Low-Light Images via Decomposition-and-Enhancement [Pdf]
    • K. Xu, X. Yang, B. Yin and R. W. H. Lau, "Learning to Restore Low-Light Images via Decomposition-and-Enhancement," 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2020, pp. 2278-2287, doi: 10.1109/CVPR42600.2020.00235.
  • DRBN [Pdf][Paper Link] [Project Page] [Slides]
    • W. Yang, S. Wang, Y. Fang, Y. Wang and J. Liu, "From Fidelity to Perceptual Quality: A Semi-Supervised Approach for Low-Light Image Enhancement," 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2020, pp. 3060-3069, doi: 10.1109/CVPR42600.2020.00313.
  • STARnet[Web] [Code] [Pdf]
    • Muhammad Haris, Greg Shakhnarovich, and Norimichi Ukita, "Space-Time-Aware Multi-Resolution Video Enhancement", Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  • DeepLPF [Code][Pdf]
    • Moran, S., Marza, P., McDonagh, S., Parisot, S., Slabaugh, G. DeepLPF: Deep Local Parametric Filters for Image Enhancement, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
  • Image-Adaptive-3DLUT [Code] [Pdf]
    • H. Zeng, J. Cai, L. Li, Z. Cao and L. Zhang, "Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-time," in IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020.
  • RUAS [Web] [Pdf] [Code]
    • Liu, Risheng, Long Ma, Jiaao Zhang, Xin Fan, and Zhongxuan Luo. “Retinex-Inspired Unrolling with Cooperative Prior Architecture Search for Low-Light Image Enhancement.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 10561–70, 2021.
    • 🔖 retinex
  • Deep denoising of flash and no-flash pairs for photography in low-light environments [Pdf]
    • Zhihao Xia, Michael Gharbi, Federico Perazzi, Kalyan Sunkavalli, and Ayan Chakrabarti. “Deep Denoising of Flash and No-Flash Pairs for Photography in Low-Light Environments.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2063–72, 2021.
  • HORUS [Pdf]
    • Moseley, Ben, Valentin Bickel, Ignacio G. Lopez-Francos, and Loveneesh Rana. “Extreme Low-Light Environment-Driven Image Denoising over Permanently Shadowed Lunar Regions with a Physical Noise Model.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 6317–27, 2021.
  • Learning temporal consistency for low light video enhancement from single images [Pdf] [Code]
    • Zhang, Fan, Yu Li, Shaodi You, and Ying Fu. “Learning Temporal Consistency for Low Light Video Enhancement from Single Images.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 4967–76, 2021.
  • Nighttime visibility enhancement by increasing the dynamic range and suppression of light effects [Pdf]
    • Sharma, Aashish, and Robby T. Tan. “Nighttime Visibility Enhancement by Increasing the Dynamic Range and Suppression of Light Effects.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 11977–86, 2021.
  • SDSD [Pdf] [Code]
    • Ruixing Wang, Xiaogang Xu, Chi-Wing Fu, Jiangbo Lu, Bei Yu, and Jiaya Jia. “Seeing Dynamic Scene in the Dark: A High-Quality Video Dataset with Mechatronic Alignment.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 9700–9709, 2021.
  • DeepHDRVideo: [Pdf] [Web] [Code]
    • Chen, Guanying, Chaofeng Chen, Shi Guo, Zhetong Liang, Kwan-Yee K. Wong, and Lei Zhang. “HDR Video Reconstruction: A Coarse-to-Fine Network and a Real-World Benchmark Dataset.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2502–11, 2021.
  • MID: [Pdf] [Web] [Code]
    • Song, Wenzheng, Masanori Suganuma, Xing Liu, Noriyuki Shimobayashi, Daisuke Maruta, and Takayuki Okatani. “Matching in the Dark: A Dataset for Matching Image Pairs of Low-Light Scenes.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 6029–38, 2021.
  • UTVNet: [Pdf] [Code]
    • Zheng, Chuanjun, Daming Shi, and Wentian Shi. “Adaptive Unfolding Total Variation Network for Low-Light Image Enhancement.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 4439–48, 2021.
  • LLVIP [Pdf] [Code] [Web]
    • Jia, Xinyu, Chuang Zhu, Minzhen Li, Wenqi Tang, and Wenli Zhou. “LLVIP: A Visible-Infrared Paired Dataset for Low-Light Vision.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 3496–3504, 2021.
  • LLFlow [Pdf] [Code] [Web]
    • Yufei Wang, Renjie Wan, Wenhan Yang, Haoliang Li, Lap-pui Chau, and Alex C. Kot “Low-Light Image Enhancement with Normalizing Flow.” In AAAI Conference on Artificial Intelligence, 2022.

Other methods

  • Fast centre-surround contrast modification [Pdf]
    • V. Vonikakis, I. Andreadis and A. Gasteratos, "Fast centre-surround contrast modification," in IET Image Processing, vol. 2, no. 1, pp. 19-34, Feb. 2008
  • Fast efficient algorithm for enhancement of low lighting video [Pdf] [Code]
    • Xuan Dong et al., "Fast efficient algorithm for enhancement of low lighting video," 2011 IEEE International Conference on Multimedia and Expo, Barcelona, 2011
  • ALSM [Pdf]
    • Y.-F. Wang, H.-M. Liu, and Z.-W. Fu, “Low-Light Image Enhancement via the Absorption Light Scattering Model,” IEEE Transactions on Image Processing, vol. 28, no. 11, pp. 5679–5690, Nov. 2019
  • Maximum and Guided Filters [Pdf]
    • D. Zhu, G. Chen, P. N. Michelini and H. Liu, "Fast Image Enhancement Based on Maximum and Guided Filters," 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan, 2019

Latest methods

  • Y. Zhang, X. Di, B. Zhang, and C. Wang, “Self-supervised Image Enhancement Network: Training with Low Light Images Only,” arXiv:2002.11300 [cs, eess], Feb. 2020, Accessed: May 25, 2020. [Online]. Available: http://arxiv.org/abs/2002.11300.
  • F. Lv, Y. Li, and F. Lu, “Attention Guided Low-light Image Enhancement with a Large Scale Low-light Simulation Dataset,” arXiv:1908.00682 [cs, eess], Mar. 2020, Accessed: May 25, 2020. [Online]. Available: http://arxiv.org/abs/1908.00682.
  • X. Li et al., “Visual Perception Model for Rapid and Adaptive Low-light Image Enhancement,” arXiv:2005.07343 [cs, eess], May 2020, Accessed: May 25, 2020. [Online]. Available: http://arxiv.org/abs/2005.07343.
  • W. Xiong, D. Liu, X. Shen, C. Fang, and J. Luo, “Unsupervised Real-world Low-light Image Enhancement with Decoupled Networks,” arXiv:2005.02818 [cs, eess], May 2020, Accessed: May 25, 2020. [Online]. Available: http://arxiv.org/abs/2005.02818.
  • Q. Fu, X. Di, and Y. Zhang, “Learning an Adaptive Model for Extreme Low-light Raw Image Processing,” arXiv:2004.10447 [cs, eess], Apr. 2020, Accessed: May 25, 2020. [Online]. Available: http://arxiv.org/abs/2004.10447.

Related works

  • Improving the robustness in feature detection by local contrast enhancement [Pdf]

  • V. Vonikakis, D. Chrysostomou, R. Kouskouridas and A. Gasteratos, "Improving the robustness in feature detection by local contrast enhancement," 2012 IEEE International Conference on Imaging Systems and Techniques Proceedings, Manchester, 2012

  • dataset VV

  • Automatic Photo Adjustment Using Deep Neural Networks [Web] [Code] [Pdf]

  • Z. Yan, H. Zhang, B. Wang, S. Paris, and Y. Yu, “Automatic Photo Adjustment Using Deep Neural Networks,” ACM Transactions on Graphics, 2015.

  • Distort-and-Recover [Code] [Pdf]

    • J. Park, J. Y. Lee, D. Yoo, and I. S. Kweon, “Distort-and-Recover: Color Enhancement using Deep Reinforcement Learning,” presented at the CVPR, 2018, doi: 10.1109/CVPR.2018.00621.

  • REGDet[Pdf]

    • J. Liang et al., “Recurrent exposure generation for low-light face detection,” 2020.
    • 🔖 application - face detection

  • HLA-Face [Web] [Pdf] [Code]

    • Wang, Wenjing, Wenhan Yang, and Jiaying Liu. “HLA-Face: Joint High-Low Adaptation for Low Light Face Detection.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 16195–204, 2021.
    • 🔖 application - face detection

  • Single-Stage Face Detection [Pdf]

    • Yu, Jun, Xinlong Hao, and Peng He. “Single-Stage Face Detection under Extremely Low-Light Conditions.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 3523–32, 2021.

  • DeLiEve-Net

    • Zhou, Chu, Minggui Teng, Jin Han, Chao Xu, and Boxin Shi. “DeLiEve-Net: Deblurring Low-Light Images with Light Streaks and Local Events.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) Workshops, 1155–64, 2021.

  • MAET [Pdf] [Code]

    • Cui, Ziteng, Guo-Jun Qi, Lin Gu, Shaodi You, Zenghui Zhang, and Tatsuya Harada. “Multitask AET With Orthogonal Tangent Regularity for Dark Object Detection.” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2553–62, 2021.

  • Photon-Net: Photon-Starved Scene Inference using Single Photon Cameras [Pdf][Video][Code]

    • Goyal, Bhavya, and Mohit Gupta. "Photon-Starved Scene Inference using Single Photon Cameras." Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021.

Reviews

  • Benchmarking Low-Light Image Enhancement and Beyond [Pdf]
    • J. Liu, D. Xu, W. Yang, M. Fan, and H. Huang, “Benchmarking Low-Light Image Enhancement and Beyond,” Int J Comput Vis, Jan. 2021, doi: 10.1007/s11263-020-01418-8.
    • 🔆 highlight!
  • Low-Light Image and Video Enhancement Using Deep Learning: A Survey [Pdf]
    • Li, Chongyi, Chunle Guo, Ling-Hao Han, Jun Jiang, Ming-Ming Cheng, Jinwei Gu, and Chen Change Loy. “Low-Light Image and Video Enhancement Using Deep Learning: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 1–1. https://doi.org/10.1109/TPAMI.2021.3126387.

Metrics

  • MSE
  • SSIM
  • entropy (DE)
  • EME
  • AB
  • PixDist
  • LOE

Blogs & Slices

Reference

Supplementary

Tags

  • 🔆 highlight!
  • 🔖 retinex