/awesome-ISP

A curated list of awesome ISP frameworks, papers, libraries, resources, and shiny things.

MIT LicenseMIT

Awesome-ISP (in progress)

A curated list of ISP good stuff. This list can contain anything related to the ISP and welcome pull requests.

Content

Courses, books & examples

Courses

Stanford CS448A -- Computational photography [Project Page]

Books

Image sensors and signal processing for digital still cameras -- Junichi Nakamura [pdf]

Examples

Infinite-ISP -- An open source ISP pipeline written in Python [code]
openISP -- Open Image Signal Processor [code]
fast-openISP -- Fast Open Image Signal Processor [code]
camera-pipeline -- A Software Platform for Manipulating the Camera Imaging Pipeline [code]
ISP Pipeline -- Algorithms of ISP Pipeline [code]
ISP-pipeline-hdrplus -- An open source (C / C + +) image algorithm library [code]

Open Source Camera Driver

V4L2 -- Video4Linux (V4L for short) is a collection of device drivers and an API for supporting realtime video capture on Linux systems [code]
HAL -- Android's camera hardware abstraction layer [code]
libcamera -- A complex camera support library for Linux, Android, and ChromeOS [code]

Raw data decoder

MatRaw -- Read and Process Camera Raw Data with MATLAB [code]
dcraw -- Decoding raw digital photos in Linux [code]
LibRaw -- Library for reading and processing of RAW digicam images [code]
Adobe DNG SDK -- The Adobe DNG SDK provides support for reading and writing DNG files as well as support for converting DNG data into a format easily displayed or processed by imaging applications [code]

Camera Pipeline

End to End Pipeline

Model Published Code Keywords
CycleISP CVPR 20 Pytorch converting sRGB images to RAW data, and then back to sRGB images
MW-ISPNet AIM 20 Pytorch Multi-level Wavelet Network
PyNET CVPR 20 Pytorch Replacing Mobile Camera ISP with a Single Deep Learning Model

AE

Simatest -- Simatest is designed to simulate exposures of a 'scene' made with a virtual camera. [code]
Automatic Camera Exposure Control. [code]

LSC

Model Published Code Keywords
TPAMI 09 C++/Matlab Single-Image Vignetting Correction
C Lens shading analysis tool
Qt Raspberry Pi camera lens shading table editor

AWB

  • Survey
Published Keywords
TIP 11 Computational Color Constancy Survey and Experiments
  • Low-Level Statistics-Based Methods
Model Published Code Keywords
TIP 02 C++ A comparison of color constancy algorithms
  • Characterized-Based Methods
Model Published Code Keywords
Fast Fourier Color Constancy CVPR 17 Matlab The Fast Fourier Color Constancy (FFCC) Matlab Toolbox

Demosaic

Model Published Code Keywords
Linear Interpolation ICASSP 04 High-Quality Linear Interpolation
Residual Interpolation ICIP 13 matlab
Directional Filtering and a posteriori Decision TIP 07 Python

CCM

Model Published Code Keywords
Root/Polynomial TIP 15 matlab
Colour Correction Toolbox AIC 17 matlab Multi algorithm integration

NR(Code coming soon...)

Benchmark and Dataset

Noise model and estimation

Noise, Dynamic Range and Bit Depth in Digital SLRs [Web Page]
A blog of Camera Noise [Web Page]
Practical Deep Raw Image Denoising on Mobile Devices [ECCV 2020]
A Physics-based Noise Formation Model for Extreme Low-light Raw Denoising [cvpr 2020]

Filtering

  • Bilatral filter
    • A Gentle Introduction to Bilateral Filtering and its Applications. Paris et al. SIGGRAPH 2008 Course Notes. [code]
  • Guided filter
    • Guided image filtering(ECCV 2010). Kaiming He et al.
    • Fast Guided Filter. Kaiming He et al.
  • NLM
    • A non-local algorithm for image denoising (CVPR 05), Buades et al.
    • Image denoising based on non-local means filter and its method noise thresholding (SIVP2013), B. Kumar
  • BM3D
    • Image restoration by sparse 3D transform-domain collaborative filtering (SPIE Electronic Imaging 2008), Dabov et al.

Deep denoising

  • DnCNN
    • Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising (TIP2017), Zhang et al.
  • RGB_Unprocess
    • Unprocessing Images for Learned Raw Denoising [paper]
    • Invertible Image Signal Processing [paper]

HDR/Tone Mapping

Model Published Code Keywords
Local Laplacian Filters SIGGRAPH 11 matlab
Advanced High Dynamic Range Imaging Book 17 matlab HDR Toolbox