Awesome-Face-Restoration: A repository from kingseeking

Deep Face Restoartion: Denoise, Super-Resolution, Deblur and Artifact Removal

A curated list of resources for Deep Face Restoartion

Suggest new item
Report Bug

This repository provides a summary of deep learning-based face restoration algorithms. Our classification is based on the review paper "A Survey of Deep Face Restoration: Denoise, Super-Resolution, Deblur, Artifact Removal".


Blind Face Restoration	Face Super-Resolution	Face Deblurring	Face Denoising	Face Artifact Removal

Survey paper

T. Wang, k. Zhang, X. Chen, W. Luo, J. Deng, T. Lu, X. Cao, W. Liu, H. Li, and S. Zafeiriou “A Survey of Deep Face Restoration: Denoise, Super-Resolution, Deblur, Artifact Removal,” arXiv preprint arXiv:2211.02831, 2022. [pdf]

@article{wang2022survey
  title={A Survey of Deep Face Restoration: Denoise, Super-Resolution, Deblur, Artifact Removal},
  author={Wang, Tao, and Zhang, kaihao, and Chen, Xuanxi and Luo, Wenhan and Deng, Jiankang and Lu, Tong and Cao, Xiaochun and Liu, Wei and Li, Hongdong and Zafeiriou, Stefanos},
  journal={arXiv preprint arXiv:2211.02831},
  year={2022}
}

See our paper for more details. If you have any suggestions, feel free to contact me (e-mail: taowangzj@gmail.com). Thanks.

Related Surveys
Deep Blind Face Restoration
Deep Face Super-Resolution
Deep Face Deblurring
Deep Face Denoising
Deep Face Artifact Removal
Benchmark Datasets

Related Surveys

year	Pub	Title	Link
2012	CCBR	A Survey of Face Hallucination	[paper]
2014	IJCV	A Comprehensive Survey to Face Hallucination	[paper]
2018	PR	Super-resolution for biometrics: A comprehensive survey	[paper]
2018	CICT	Face Hallucination Techniques: A Survey	[paper]
2019	IET- Image- Processing	Survey on GAN-based Face Hallucination with its Model Development	[paper]
2020	CSUR	Deep Learning-based Face Superresolution: A Survey	[paper]
2022	Arxiv	A Survey of Deep Face Restoration: Denoise, Super-Resolution, Deblur, Artifact Removal	[paper]

Deep Blind Face Restoration

Year	Pub	Title	Links	Arch
2018	ECCV	Learning Warped Guidance for Blind Face Restoration	[paper][code]	CNN
2018	CVPR	FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors	[paper][code]	CNN
2019	IJCV	Identity-preserving Face Recovery from Stylized Portraits	[paper][code]	GAN
2020	ECCV	Blind Face Restoration via Deep Multi-scale Component Dictionaries	[paper][code]	CNN
2020	CVPR	Enhanced Blind Face Restoration with Multi-Exemplar Images and Adaptive Spatial Feature Fusion	[paper][code]	CNN
2020	MM	HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment	[paper][code]	GAN
2020	CVPR	Image Processing Using Multi-Code GAN Prior	[paper][code]	GAN
2021	TPAMI	Face Restoration via Plug-and-Play 3D Facial Priors	[paper][code]	CNN
2021	CVPR	Progressive Semantic-Aware Style Transformation for Blind Face Restoration	[paper][code]	GAN
2021	CVPR	Towards Real-World Blind Face Restoration with Generative Facial Prior	[paper][code]	GAN
2021	CVPR	GAN Prior Embedded Network for Blind Face Restoration in the Wild	[paper][code]	GAN
2022	Arxiv	Multi-prior learning via neural architecture search for blind face restoration	[paper][code]	CNN
2022	CVPR	Blind Face Restoration via Integrating Face Shape and Generative Priors	[paper]~~[code]~~	GAN
2022	CVPR	RestoreFormer: High-Quality Blind Face Restoration from Undegraded Key-Value Pairs	[paper][code]	ViT
2022	NeurIPS	Towards Robust Blind Face Restoration with Codebook Lookup Transformer	[paper][code]	ViT
2022	AAAI	Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration	[paper][code]	GAN
2022	Arxiv	FaceFormer: Scale-aware Blind Face Restoration with Transformers	[paper][code]	ViT
2022	Arxiv	Blind Face Restoration: Benchmark Datasets and a Baseline Model	[paper][code]	ViT

Deep Face Super-Resolution

Year	Pub	Title	Links	Arch
2015	AAAI	Learning Face Hallucination in the Wild	[paper][code]	CNN
2016	ECCV	Deep Cascaded Bi-Network for Face Hallucination	[paper][code]	CNN
2016	ECCV	Ultra-Resolving Face Images by Discriminative Generative Networks	[paper][code]	GAN
2017	CVPR	Attention-Aware Face Hallucination via Deep Reinforcement Learning	[paper][code]	CNN
2017	CVPR	Hallucinating Very Low-Resolution Unaligned and Noisy Face Images by Transformative Discriminative Autoencoders	[paper][code]	CNN
2017	ICCV	Learning to Super-Resolve Blurry Face and Text Images	[paper][code]	GAN
2017	AAAI	Face Hallucination with Tiny Unaligned Images by Transformative Discriminative Neural Networks	[paper][code]	GAN
2018	ECCV	Face Super-resolution Guided by Facial Component Heatmaps	[paper][code]	CNN
2018	CVPR	Super-FAN: Integrated facial landmark localization and super-resolution of real-world low resolution faces in arbitrary poses with gans	[paper][code]	GAN
2018	ECCV	To learn image super-resolution, use a GAN to learn how to do image degradation first	[paper][code]	GAN
2019	CVPRW	Exemplar Guided Face Image Super-Resolution without Facial Landmarks	[paper][code]	CNN
2019	BMVC	Progressive Face Super-Resolution via Attention to Facial Landmark	[paper][code]	CNN
2020	WACV	Component Attention Guided Face Super-Resolution Network: CAGFace	[paper][code]	CNN
2020	TNNLS	Dual-Path Deep Fusion Network for Face Image Hallucination	[paper][code]	CNN
2019	NEUCOM	On potentials of regularized Wasserstein generative adversarial networks for realistic hallucination of tiny faces	[paper][code]	GAN
2020	CVPR	PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models	[paper][code]	GAN
2021	TBBIS	E-ComSupResNet: Enhanced Face Super-Resolution Through Compact Network	[paper][code]	CNN
2021	MM	Face Hallucination via Split-Attention in Split-Attention Network	[paper][code]	CNN
2021	ICIP	Progressive Face Super-Resolution with Non-Parametric Facial Prior Enhancement	[paper][code]	GAN
2022	CVPR	GCFSR: a Generative and Controllable Face Super Resolution Method Without Facial and GAN Priors	[paper][code]	GAN
2022	ECCV	VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder	[paper][code]	CNN
2022	TPAMI	EDFace-Celeb-1 M: Benchmarking Face Hallucination with a Million-scale Dataset	[paper][code]	CNN

Deep Face Deblurring

Year	Pub	Title	Links	Arch
2017	Arxiv	DeepDeblur: Fast one-step blurry face images restoration	[paper][code]	CNN
2018	CVPR	Deep Semantic Face Deblurring	[paper][code]	CNN
2020	IJCV	Exploiting Semantics for Face Image Deblurring	[paper][code]	CNN
2020	TIP	Deblurring Face Images using Uncertainty Guided Multi-Stream Semantic Networks	[paper][code]	CNN
2020	MM	HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment	[paper][code]	GAN
2020	AAAI	Learning to deblur face images via sketch synthesis	[paper][code]	CNN
2022	TOG	Face Deblurring using Dual Camera Fusion on Mobile Phones	[paper][code]	CNN
2022	WACV	Deep Feature Prior Guided Face Deblurring	[paper][code]	CNN
2022	Arxiv	Multi-prior learning via neural architecture search for blind face restoration	[paper][code]	CNN
2022	Arxiv	Blind Face Restoration: Benchmark Datasets and a Baseline Model	[paper][code]	ViT

Deep Face Denoising

Year	Pub	Title	Links	Arch
2020	MM	HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment	[paper][code]	GAN
2022	Arxiv	Multi-prior learning via neural architecture search for blind face restoration	[paper][code]	CNN
2022	Arxiv	Blind Face Restoration: Benchmark Datasets and a Baseline Model	[paper][code]	ViT

Deep Face Artifact Removal

Year	Pub	Title	Links	Arch
2020	MM	HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment	[paper][code]	GAN
2022	Arxiv	Blind Face Restoration: Benchmark Datasets and a Baseline Model	[paper][code]	ViT
2022	Arxiv	Multi-prior learning via neural architecture search for blind face restoration	[paper][code]	CNN

Benchmark Datasets

Dataset	Paper	Year
BioID	Robust face detection using the hausdorff distance	2001
LFW	Labeled faces in the wild: A database forstudying face recognition in unconstrainedenvironments	2008
Pubfig	Attribute and similar classifiers for face verification	2009
Multi-PIE	Multi-PIE	2010
AFLW	Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization	2011
Helen	Interactive Facial Feature Localization	2012
300W	300 Faces in-the-Wild Challenge: The first facial landmark localization Challenge	2013
CASIA-WebFace (Password: y3wj)	Learning Face Representation from Scratch	2014
CelebA	Deep Learning Face Attributes in the Wild	2015
IMDB-WIKI	DEX: Deep EXpectation of apparent age from a single image	2015
LSUN	LSUN: Construction of a Large-Scale Image Dataset using Deep Learning with Humans in the Loop	2015
VGGFace	Deep Face Recognition	2015
300W-LP	Face Alignment Across Large Poses: A 3D Solution	2016
VoxCeleb1	VoxCeleb: a large-scale speaker identification dataset	2017
LS3D-W	How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)	2017
LS3D-W balanced	How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)	2017
Menpo	The Menpo Facial Landmark Localisation Challenge: A step towards the solution	2017
VGGFace2	VGGFace2: A dataset for recognising faces across pose and age	2018
VoxCeleb2	Voxceleb2: Deep speaker recognition	2018
FFHQ	A Style-Based Generator Architecture for Generative Adversarial Networks	2019
CelebChild-Test	Towards Real-World Blind Face Restoration with Generative Facial Prior	2021
WebPhoto-Test	Towards Real-World Blind Face Restoration with Generative Facial Prior	2021
CelebA-Test	Towards Real-World Blind Face Restoration with Generative Facial Prior	2021
LFW-Test	Towards Real-World Blind Face Restoration with Generative Facial Prior	2021
VFHQ	VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution	2022
EDFace-Celeb-1M	EDFace-Celeb-1M: Benchmarking Face Hallucination with a Million-scale Dataset	2022
EDFace-Celeb-1M (BFR128)	Blind Face Restoration: Benchmark Datasets and a Baseline Model	2022
EDFace-Celeb-150K (BFR512)	Blind Face Restoration: Benchmark Datasets and a Baseline Model	2022

statistics

kingseeking/Awesome-Face-Restoration