/awesome-deep-colorization

A curated list of awesome resources for image/video colorization.

Deep Colorization

A curated list of awesome resources for colorization. We will keep updating it.

❗Updated 2022-07.

Content:

Preprint

Year Pub. Title Links
2021 arXiv08 Towards Photorealistic Colorization by Imagination
Chenyang Lei, Yue Wu, Qifeng Chen		 Paper/Code
2021 arXiv07 Attention-Guided NIR Image Colorization via Adaptive Fusion of Semantic and Texture Clues
Xingxing Yang, Jie Chen, Zaifeng Yang, et al.		 Paper/Code
2021 arXiv06 Color2Embed: Fast Exemplar-Based Image Colorization using Color Embeddings
Hengyuan Zhao, Wenhao Wu, et al.		 Paper/Code
2020 arXiv08 Image Colorization: A Survey and Dataset
Saeed Anwar, et al.		 Paper/Code

2022

Year Pub. Title Links
2022 ECCV Bridging the Domain Gap towards Generalization in Automatic Colorization
Hyejin Lee, Deahee Kim, DaEun Lee, Jinkyu Kim, Jaekoo Lee		 Paper/Code
2022 ECCV BigColor: Colorization using a Generative Color Prior for Natural Images
Geonung Kim, Kyoungkook Kang, Seongtae Kim, Hwayoon Lee, et al.		 Paper/Proj/
Code
2022 ECCV ColorFormer: Image Colorization via Color Memory assisted Hybrid-attention Transformer
X. Ji, B. Jiang, D. Luo, G. Tao, et al.		 Paper/Code
2022 ECCV CT2: Coloriztation Transformer via Color Tokens
Shuchen Weng, Boxin Shi, et al.		 Paper/Code
2022 CVPR Style-Structure Disentangled Features and Normalizing Flows for Diverse Icon Colorization
Yuan-Kui Li, Yu-Shuen Wang, et al.		 Paper/Code
2022 SIGGRAPH Palette: Image-to-Image Diffusion Models
Chitwan Saharia, William Chan, Huiwen Chang, Chris A Lee, Jonathan Ho, Tim Salimans, et al.		 Paper/Code
2022 AAAI SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolution
Jiangning Zhang, et al.		 Paper/Code
2022 AAAI L-CoDe: Language-based Colorization using Color-object Decoupled Conditions
Shuchen Weng, Hao Wu, et al.		 Paper/Code

2021

Year Pub. Title Links
2021 ICCV Deep Edge-Aware Interactive Colorization Against Color-Bleeding Effects
E. Kim, S. Lee, J. Park, et al.		 Paper/Proj
2021 ICCV Towards Vivid and Diverse Image Colorization with Generative Color Prior
Yanze Wu, et al.		 Paper/Code
2021 MM Yes, 'Attention Is All You Need', for Exemplar based Colorization
Wang Yin, et al.		 Paper/Code
2021 MM Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies  
Xin Jin, Dongqing Zou, et al.		 Paper/Data
2021 CVPR User-Guided Line Art Flat Filling with Split Filling Mechanism
Lvmin Zhang, Tien-Tsin Wong, et al.		 Paper/Proj
2021 CVPR HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms
M. Afifi, M. Brubaker, Michael S. Brown		 Paper/Code
2021 ICLR Colorization Transformer
M. Kumar, D. Weissenborn, Nal Kalchbrenner		 Paper/Code
2021 TIP Self-Supervised Colorization Towards Monochrome-Color Camera Systems Using Cycle CNN
Xuan Dong, Yunhong Wang, et al.		 Paper/Code
2021 TIP Dual Color Space Guided Sketch Colorization
Zhi Dou, et al.		 Paper/Code
2021 TVCG A Colorization Framework for Monochrome-Color Dual-Lens Systems using a Deep Convolutional Network
Xuan Dong, Yunhong Wang, et al.		 Paper/Code
2021 TVCG Interactive Deep Colorization and Its Application for Image Compression
Yi Xiao, et al.		 Paper/Code
2021 TVCG Palettailor: Discriminable Colorization for Categorical Data
Kecheng Lu, et al.		 Paper/Code
2021 TNNLS Broad Colorization
Yuxi Jin, et al.		 Paper/Code
2021 TMM VCGAN: Video Colorization with Hybrid Generative Adversarial Network
Yuzhi Zhao, et al.		 arXiv/Code

2020

Year Pub. Title Links
2020 MM Gray2ColorNet: Transfer More Colors from Reference Image
Peng Lu, et al.		 Paper/Code
SUPP
2020 ECCV Learn to Recover Visible Color for Video Surveillance in a Day
G. Wu, Yinqiang Zheng, et al.		 Paper/Code
2020 ECCV Colorization of Depth Map via Disentanglement
Chung-Sheng Lai, et al.		 Paper/Code
2020 CVPR ColorFool: Semantic Adversarial Colorization
Ali Shahin Shamsabadi et al.		 Paper/Code
2020 CVPR Instance-Aware Image Colorization
J. Su, H. Chu, Jia-Bin Huang		 Paper/Code
Proj
2020 CVPR Stylization-Based Architecture for Fast Deep Exemplar Colorization
Zhongyou Xu, et al.		 Paper/Code
2020 CVPR Reference-Based Sketch Image Colorization Using Augmented-Self Reference and Dense Semantic Correspondence
Junsoo Lee, et al.		 Paper/Code
Proj
2020 AAAI Cycle-CNN for Colorization towards Real Monochrome-Color Camera Systems 
Xuan Dong, Yunhong Wang, et al.		 Paper/Code
2020 IJCV Pixelated Semantic Colorization
Jiaojiao Zhao, Jungong Han, et al.		 Paper/Code
2020 TVCG A Superpixel-Based Variational Model for Image Colorization
Faming Fang, Guixu Zhang, et al.		 Paper/Code
2020 TVCG Active Colorization for Cartoon Line Drawings
Shu-Yu Chen, et al.		 Paper/Code
2020 TMM Automated Colorization of a Grayscale Image With Seed Points Propagation
Shaohua Wan, et al.		 Paper/Code
2020 TSCVT SCGAN: Saliency Map-guided Colorization with Generative Adversarial Network
Yuzhi Zhao, et al.		 arXiv/Code

2019

Year Pub. Title Links
2019 SIGA DeepRemaster: temporal source-reference attention networks for comprehensive video enhancement
Satoshi Iizuka, Edgar Simo-Serra		 Paper/Code
Proj
2019 SIGA Language-based Colorization of Scene Sketches
Changqing Zou, Haoran Mo, et al.		 Paper/Code/
Proj
2019 ICCV Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss
Hyunsu Kim, et al.		 Paper/Code
2019 MM Adversarial Colorization of Icons based on Contour and Color Conditions
Tsai-Ho Sun, Chien-Hsun Lai, et al.		 Paper/Code
2019 CVPR Fully Automatic Video Colorization With Self-Regularization and Diversity
Chenyang Lei, Qifeng Chen, et al.		 Paper/Code
Proj
2019 CVPR Deep Exemplar-Based Video Colorization
Bo Zhang, et al.		 Paper/Code
2019 CVPR Coloring With Limited Data: Few-Shot Colorization via Memory Augmented Networks
Seungjoo Yoo, et al.		 Paper/Code
Proj
2019 CVPRW Image Colorization by Capsule Networks
Gokhan Ozbulak		 Paper/Code
2019 CVPRW Robust Image Colorization Using Self Attention Based Progressive Generative Adversarial Network
Manoj Sharma, et al.		 Paper/Code
2019 AAAI Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System 
Xuan Dong, Yunhong Wang, et al.		 Paper/Code
2019 TIP Automatic Example-Based Image Colorization Using Location-Aware Cross-Scale Matching
Bo Li, Yu-Kun Lai, et al.		 Paper/Code
2019 CGF Example-Based Colourization Via Dense Encoding Pyramids
Chufeng Xiao, Tien-Tsin Wong, et al.		 Paper/Code

2018

Year Pub. Title Links
2018 ECCV Tracking Emerges by Colorizing Videos
Carl Vondrick, et al.		 Paper/Code
2018 ECCV Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation
Hyojin Bahng, Seungjoo Yoo, et al.		 Paper/Code
2018 ECCV Structural Consistency and Controllability for Diverse Colorization
Safa Messaoud, David Forsyth, et al.		 Paper/Code
2018 ECCV Switchable Temporal Propagation Network
Sifei Liu, Ming-Hsuan Yang, et al.		 Paper/Code
2018 MM User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks
Yuanzheng Ci, et al.		 Paper/Code
2018 SIG Deep Exemplar-based Colorization
Mingming He, Lu Yuan, et al.		 Paper/Code
2018 SIG Progressive Color Transfer with Dense Semantic Correspondences
Mingming He, Lu Yuan, et al.		 Paper/Code
2018 SIGA Two-stage sketch colorization
Lvmin Zhang, Tien-Tsin Wong, et al.		 Paper/Proj
2018 AAAI Learning Generative Neural Networks for 3D Colorization             
Z. Yang, L. Liu, Qixing Huang		 Paper/Codee
2018 TVCG A Data-Driven Approach for Furniture and Indoor Scene Colorization
Jie Zhu, Yanwen Guo, Han Ma		 Paper/Code

2017

Year Pub. Title Links
2017 CVPR Learning Diverse Image Colorization
Aditya Deshpande, David Forsyth, et al.		 Paper/Code
2017 CVPR Colorization as a Proxy Task for Visual Understanding
Gustav Larsson, Michael Maire, et al.		 Paper/Code
Proj
2017 CVPR Image-to-Image Translation with Conditional Adversarial Networks 
P. Isola, Jun-Yan Zhu, et al.		 Paper/Code
2017 CVPR Generalized Deep Image to Image Regression
V. Santhanam, Vlad I. Morariu, Larry S. Davis		 Paper/Code
2017 CVPR Scribbler: Controlling Deep Image Synthesis with Sketch and Color
Patsorn Sangkloy, Fisher Yu, et al.		 Paper/Code
2017 CVPR Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
Richard Zhang, Phillip Isola, Alexei A. Efros		 Paper/Code
Proj
2017 SIG Real-Time User-Guided Image Colorization with Learned Deep Priors
Richard Zhang, Jun-Yan Zhu, et al.		 Paper/Code
Proj
2017 TIP Colorization Using Neural Network Ensemble
Z. Cheng, Q. Yang, Bin Sheng		 Paper/Code

2016

Year Pub. Title Links
2016 ECCV Colorful Image Colorization
Richard Zhang, Phillip Isola, Alexei A. Efros		 Paper/Code
Proj
2016 ECCV Learning Representations for Automatic Colorization
G. Larsson, M. Maire, and G. Shakhnarovich		 Paper/Code
Proj
2016 SIG Let there be Color! Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification  
Satoshi Iizuka, Edgar Simo-Serra Hiroshi Ishikawa		 Paper/Code
Proj

2015

Year Pub. Title Links
2015 ICCV Learning Large-Scale Automatic Image Colorization
A. Deshpande, J. Rock, David Forsyth		 Paper/Code
Proj
2015 ICCV Depth Map Estimation and Colorization of Anaglyph Images Using Local Color Prior and Reverse Intensity Distribution  
Williem, Ramesh Raskar, In Kyu Park		 Paper/Code
2015 ICCV Deep Colorization
Z. Cheng, Q. Yang, Bin Sheng		 Paper/Code
Ext

Colorization Others

Year Pub. Title Links
2017 ICCV CycleGAN: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu, T. Park, P. Isola, Alexei A. Efros		 Paper/Code
Proj
2017 CVPR Pix2Pix: Image-to-Image Translation with Conditional Adversarial Nets 
P. Isola, Jun-Yan Zhu, T. Zhou, Alexei A. Efros		 Paper/Code
Proj

Appendix