t-kuha/deep-image-processing

Deep learning in image processing

Deep Image Processing

• Deep learning in image processing (especially real-world photography)

• Similar repos: deep-imaging & Neural Networks for Low Level Image Processing

  • Seems not maintained anymore

---

Processing Pipeline

• Transform Your Smartphone into a DSLR Camera: Learning the ISP in the Wild (ECCV 2022): Paper / GitHub (code to be committed)

• CameraNet: A Two-Stage Framework for Effective Camera ISP Learning (IEEE Transactions on Image Processing, 2020): Paper / GitHub

• Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipeline (CVPR 2020): Website / Paper / GitHub

• Hardware-in-the-loop End-to-end Optimization of Camera Image Processing Pipelines: Website / Paper

• Hyperparameter Optimization in Black-box Image Processing using Differentiable Proxies: Website / Paper

• Replacing Mobile Camera ISP with a Single Deep Learning Model: Website / Paper / GitHub

• Zoom to Learn, Learn to Zoom (CVPR 2019): Website / Paper / GitHub

• DeepISP: Towards Learning an End-to-End Image Processing Pipeline (IEEE TIP 2019): Paper / Dataset

• VisionISP: Repurposing the Image Signal Processor for Computer Vision Applications (ICIP 2019): IEEE

• Deep Camera: A Fully Convolutional Neural Network for Image Signal Processing (ICCV 2019): Paper

• CameraNet: A Two-Stage Framework for Effective Camera ISP Learning: Paper

• DEEP LEARNING for Image and Video Processing: Slide

• Modelling the Scene Dependent Imaging in Cameras with a Deep Neural Network (ICCV 2017): Paper / Supplementary Material

• DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks (ICCV 2017): Paper / Website

• Deep Semantics-Aware Photo Adjustment: Paper

• Automatic Photo Adjustment Using Deep Neural Networks (ACM Transactions on Graphics, 2015): Paper / GitHub / Website

---

Exposure Correction

• Learning Multi-Scale Photo Exposure Correction: Paper / GitHub / PyTorch version

---

Image Enhancement

• CURL: Neural Curve Layers for Image Enhancemen: Paper / GitHub

• Deep Photo Enhancer: Unpaired Learning for Image Enhancement from Photographs with GANs (CVPR 2018): GitHub

---

Aesthetics

• Similar GitHub repo: Awesome Image Aesthetic Assessment and Cropping

• Composition and Style Attributes Guided Image Aesthetic Assessment: Paper

• Neural Aesthetic Image Reviewer: Paper

• A Deep Learning Perspective on Beauty, Sentiment, and Remembrance of Art: Paper

• Image Aesthetics Assessment using Fully Convolutional Neural Networks: Paper

• Neural Image Assessment: Google AI Blog / Paper

• Personalized Image Aesthetics: Paper / GitHub

• RAPID: Rating Pictorial Aesthetics using Deep Learning: Paper

• Papers with Code: Aesthetics Quality Assessment

---

Cropping/Composition

• Composing Photos Like a Photographer (CVPR 2021): Paper / Supplement

• Reliable and Efficient Image Cropping: A Grid Anchor based Approach (CVPR 2019): Paper / GitHub1 / GitHub2 / GitHub3

• Speedy Neural Networks for Smart Auto-Cropping of Images: Website

• Papers with Code: Image Cropping

• Similar repo: Awesome-Aesthetic-Evaluation-and-Cropping

---

Demosaicing

• Learning Deep Convolutional Networks for Demosaicing: Website / Paper

• Deep Demosaicing using ResNet-Bottleneck Architecture: Paper

• Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution: Paper / GitHub

• Learning to Compose with Professional Photographs on the Web (ACM Multimedia 2017): Paper / GitHub / GitHub

• Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Study (IEEE WACV 2017): Website / Paper / GitHub

• Papers with Code: Demosaicking

---

White Balance/Illuminant Estimation/Color Constancy

• Object-based color constancy in a deep neural network (JOSA A 2023): Paper

• A Multi-Hypothesis Approach to Color Constancy: Paper / GitHub

• Deep White-Balance Editing: Paper / GitHub

• Dual Illumination Estimation for Robust Exposure Correction: Paper

• Formulating Camera-Adaptive Color Constancy as a Few-shot Meta-Learning Problem: Paper

• Semantic White Balance: Semantic Color Constancy Using Convolutional Neural Network: Paper

• FC4: Fully Convolutional Color Constancy with Confidence-weighted Pooling (CVPR 2017): Paper / GitHub

• Papers with Code: Color Constancy

• Related repo: Awesome Color Constancy

• Color Constancy - Research Website on Illuminant Estimation

---

Denoising/Noise Modeling

• CycleISP: Real Image Restoration via Improved Data Synthesis (CVPR 2020): Paper / GitHub

• Generating Training Data for Denoising Real RGB Images via Camera Pipeline Simulation: Website

• A Holistic Approach to Cross-Channel Image Noise Modeling and its Application to Image Denoising (CVPR 2016): Paper / Supplementary Material / Website / GitHub

---

Reversion (RGB -> RAW)

• Learning sRGB-to-Raw-RGB De-rendering with Content-Aware Metadata (CVPR 2022): Paper / GitHub

---

Datasets

• MIT-Adobe FiveK Dataset: Website

• Smartphone Image Denoising Dataset: Website