/Image-Extrapolation

What I cannot create, I do not understand.

Primary LanguagePython

Image-Extrapolation

What I cannot create, I do not understand.

This repository is a paper list of image extrapolation and inpainting inspired by @1900zyh's repository Awsome-Image-Inpainting and @geekyutao's repository Image Inpainting. As a conditional generation task, I learn from @xiaweihao's repository awesome-image-translation.

Benchmarks for Image Extrapolation

Dataset Metrics Method Title
CelebA-HQ (75%) PSNR=16.05 SSIM=0.6815 FID=21.17 SpiralNet Spiral Generative Network for Image Extrapolation
Stanford cars (75%) PSNR=14.31 SSIM=0.5775 FID=23.64 SpiralNet Spiral Generative Network for Image Extrapolation
CUB (75%) PSNR=16.22 SSIM=0.5313 FID=56.50 SpiralNet Spiral Generative Network for Image Extrapolation
Flowers (75%) PSNR=15.67 SSIM=0.5078 FID=52.14 SpiralNet Spiral Generative Network for Image Extrapolation
Cityscapes (50%) PSNR=20.43 SSIM=0.7125 FID=22.34 SpiralNet Spiral Generative Network for Image Extrapolation
Paris StreetView (50%) PSNR=17.43 SSIM=0.5970 FID=35.58 SpiralNet Spiral Generative Network for Image Extrapolation
Places365-Sky (50%) PSNR=21.75 SSIM=0.7834 FID=51.55 SpiralNet Spiral Generative Network for Image Extrapolation
Places365-Desert Road (50%) PSNR=20.22 SSIM=0.7026 FID=80.66 SpiralNet Spiral Generative Network for Image Extrapolation
Places365 (25%) PSNR=10.17 FID=0.79 Boundless Boundless: Generative Adversarial Networks for Image Extension
Places365 (50%) PSNR=8.63 FID=3.46 Boundless Boundless: Generative Adversarial Networks for Image Extension
Places365 (75%) PSNR=8.07 FID=8.79 Boundless Boundless: Generative Adversarial Networks for Image Extension
SUN IS=2.852 FID=13.713 NS-Outpainting Very Long Natural Scenery Image Prediction by Outpainting
DeepFashion PSNR=12.58 SSIM=0.5686 SRN Wide-Context Semantic Image Extrapolation

Benchmarks for Image Inpainting

Dataset Metrics Method Title
CelebA (25%) PSNR=26.32 SSIM=0.910 FID=25.51 MEDFE Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
CelebA (10-20%) PSNR=34.69 SSIM=0.989 l1err.=0.72% l2err. =0.04% CSA Coherent Semantic Attention for Image Inpainting
CelebA (20-30%) PSNR=32.58 SSIM=0.982 l1err.=0.94% l2err. =0.07% CSA Coherent Semantic Attention for Image Inpainting
CelebA (30-40%) PSNR=25.32 SSIM=0.926 l1err.=2.18% l2err. =0.37% CSA Coherent Semantic Attention for Image Inpainting
CelebA (40-50%) PSNR=24.14 SSIM=0.883 l1err.=2.85% l2err. =0.44% CSA Coherent Semantic Attention for Image Inpainting
CelebA-HQ PSNR=29.4912 SSIM=0.9606 L2=0.14 LPIPS=0.0682 SC-FEGAN SC-FEGAN: Face Editing Generative Adversarial Network with User’s Sketch and ColorRethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Paris StreetView (10%-20%) PSNR=28.73 SSIM=0.889 LBAM Image Inpainting with Learnable Bidirectional Attention Maps
Paris StreetView (20%-30%) PSNR=26.16 SSIM=0.795 LBAM Image Inpainting with Learnable Bidirectional Attention Maps
Paris StreetView (30%-40%) PSNR=24.26 SSIM=0.716 LBAM Image Inpainting with Learnable Bidirectional Attention Maps
Paris StreetView (40%-50%) PSNR=22.62 SSIM=0.621 LBAM Image Inpainting with Learnable Bidirectional Attention Maps
Place2 (10%-20%) PSNR=31.13 SSIM=0.957 FID=6.91 MEDFE Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (20%-30%) PSNR=28.87 SSIM=0.923 FID=8.06 MEDFE Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (30%-40%) PSNR=25.34 SSIM=0.854 FID=19.36 MEDFE Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (40%-50%) PSNR=22.81 SSIM=0.719 FID=28.79 MEDFE Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (0-20%) PSNR=32.029 SSIM=0.9738 FID=2.9420 StructureFlow StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (20%-40%) PSNR=25.218 SSIM=0.9026 FID=7.0354 StructureFlow StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (40%-60%) PSNR=21.090 SSIM=0.7561 FID=22.3803 StructureFlow StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (rectangular) l1 err.=8.6% l2 err.=2.0% SN-PatchGAN StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (free-form) l1 err.=9.1% l2 err.=1.6% SN-PatchGAN Free-Form Image Inpainting with Gated Convolution

Deep-Learning-based Extrapolation Methods

Year Proceeding Title Comment
2021 WACV 2021 Painting Outside as Inside: Edge Guided Image Outpainting via Bidirectional Rearrangement with Progressive Step Learning [paper] [code]
2021 WACV 2021 DeepCFL: Deep Contextual Features Learning from a Single Image [paper] InGAN
2020 ECCV 2020 Spiral Generative Network for Image Extrapolation [paper] [Springer] [code]
2020 CVPR 2020 Semantic Pyramid for Image Generation [paper] [code] Re-painting
2020 WACV 2020 Multimodal Image Outpainting with Regularized Normalized Diversification [paper] [code] GAN-based
2020 WACV 2020 360 Panorama Synthesis from a Sparse Set of Images with Unknown Field of View [paper] [code] GAN-based
2020 ITNEC 2020 Image extrapolation based on multi-column convolutional attention network [paper]
2020 SPL 2020 SiENet: Siamese Expansion Network for Image Extrapolation [paper] [code] SCI-3
2020 ICIP 2020 Image Completion and Extrapolation with Contextual Cycle Consistency [paper]
2019 ICCV 2019 Boundless: Generative Adversarial Networks for Image Extension [pdf] [code]
2019 ICCV 2019 Very Long Natural Scenery Image Prediction by Outpainting [pdf] [code] LSTM
2019 ICCV 2019 COCO-GAN: Generation by Parts via Conditional Coordinating [pdf] [official code] [unofficial code]
2019 SIGGRAPH 2019 Structure-Aware Image Expansion with Global Attention [paper]
2019 CVPR 2019 Wide-Context Semantic Image Extrapolation [paper] [code]
2019 TIP 2019 Deep Portrait Image Completion and Extrapolation [paper]
2018 ECCV 2018 Unsupervised Holistic Image Generation from Key Local Patches [paper] [code] GAN-based
2018 arXiv:1808.08483 Painting Outside the Box: Image Outpainting with GANs [paper] [code] [code] GAN-based

Traditional Extrapolation Methods

Year Proceeding Title Comment
2003 ACM TOG 2003 Poisson Image Editing [paper]
2007 ACM TOG 2007 Seam Carving for Content-Aware Image Resizing [paper]
2008 CVPRW 2008 Creating and Exploring a Large Photorealistic Virtual Space [paper] [paper]
2009 ACM TOG 2009 PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [paper]
2012 SIGGRAPH 2012 Quality Prediction for Image Completion [paper]
2013 CVPR 2013 FrameBreak: Dramatic Image Extrapolation by Guided Shift-Maps [paper] [code]
2014 ECCV 2014 Photo uncrop [paper] [code]
2014 ACM TOG 2014 BiggerPicture: data-driven image extrapolation using graph matching [paper]

Inpainting Deep-Learning-based Methods

Year Proceeding Title Comment
2012 NIPS 2012 Image denoising and inpainting with deep neural networks [pdf]
2014 GCPR 2014 Mask-specific inpainting with deep neural networks [pdf]
2014 NIPS 2014 Deep Convolutional Neural Network for Image Deconvolution [pdf]
2015 NIPS 2015 Shepard Convolutional Neural Networks [pdf] [code]
2015 PR 2015 Application of GRNN neural network in non-texture image inpainting and restoration [paper] CNN-based
2015 AICCSA 2015 Moving objects detection based on thresholding operations for video surveillance systems [paper] GAN-based
2016 CVPR 2016 Context Encoders: Feature Learning by Inpainting [pdf] [code] [blog1] [blog2] CNN-based
2016 SIGGRAPH 2016 High-resolution multi-scale neural texture synthesis [pdf]
2016 ELCVIA 2016 A block-based background model for moving object detection [paper] GAN-based
2016 JEI 2016 Moving object detection using a background modeling based on entropy theory and quad-tree decomposit [paper] GAN-based
2017 CVPR 2017 Semantic image inpainting with deep generative models [pdf] [code] [blog]
2017 CVPR 2017 High-resolution image inpainting using multi-scale neural patch synthesis [pdf] [code] [blog]
2017 CVPR 2017 Generative Face Completion [pdf] [code] [blog]
2017 CVPR 2017 Joint gap detection and inpainting of line drawings [paper] CNN-based
2017 SIGGRAPH 2017 Globally and Locally Consistent Image Completion [pdf] [code] [blog]
2017 VC 2017 Blind inpainting using the fully convolutional neural network [paper] CNN-based
2017 ICVISP 2017 High-resolution image inpainting through multiple deep networks [paper] CNN-based
2017 ICDAR 2017 Scene Text Eraser [paper] CNN-based
2017 ICCC 2017 A Deep Network Architecture for Image Inpainting [paper] CNN-based
2018 CVPR 2018 Generative Image Inpainting with Contextual Attention [pdf] [code]
2018 CVPR 2018 Natural and Effective Obfuscation by Head Inpainting [pdf]
2018 CVPR 2018 Eye In-Painting With Exemplar Generative Adversarial Networks [pdf] [code]
2018 CVPR 2018 UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition [pdf]
2018 CVPR 2018 Disentangling Structure and Aesthetics for Style-aware Image Completion [pdf]
2018 ECCV 2018 Image Inpainting for Irregular Holes Using Partial Convolutions [pdf] [code] [blog]
2018 ECCV 2018 Contextual-based Image Inpainting: Infer, Match, and Translate [pdf]
2018 ECCV 2018 Shift-Net: Image Inpainting via Deep Feature Rearrangement [pdf] [code] CNN-based
2018 NIPS 2018 Image Inpainting via Generative Multi-column Convolutional Neural Networks [pdf] [code]
2018 TOG 2018 Faceshop: Deep sketch-based face image editing [pdf]
2018 ACM MM 2018 Structural inpainting [pdf]
2018 ACM MM 2018 Semantic Image Inpainting with Progressive Generative Networks [pdf] [code]
2018 BMVC 2018 SPG-Net: Segmentation Prediction and Guidance Network for Image Inpainting [pdf] [code] Segmentation
2018 BMVC 2018 MC-GAN: Multi-conditional Generative Adversarial Network for Image Synthesi [pdf] [code]
2018 ACCV 2018 Face Completion with Semantic Knowledge and Collaborative Adversarial Learning [pdf]
2018 ICASSP 2018 Edge-Aware Context Encoder for Image Inpainting [pdf]
2018 ICPR 2018 Deep Structured Energy-Based Image Inpainting [pdf] [code]
2018 AISTATS 2019 Probabilistic Semantic Inpainting with Pixel Constrained CNNs [pdf]
2018 ICRA 2018 Just-in-time reconstruction: Inpainting sparse maps using single view depth predictors as priors [paper] CNN-based
2018 SPIC 2018 A deep learning approach to patch-based image inpainting forensics [paper] CNN-based
2018 MS 2018 Semantic object removal with convolutional neural network feature-based inpainting approach [paper] CNN-based
2018 NCA 2018 Occluded offline handwritten Chinese character recognition using deep convolutional generative adversarial network and improved GoogLeNet [paper] GAN-based
2018 TIP 2018 Perceptual Adversarial Networks for Image-to-Image Transformation [paper] GAN-based
2018 GRSL 2018 Inpainting of Remote Sensing SST Images With Deep Convolutional Generative Adversarial Network [paper] GAN-based
2018 PRRS 2018 Preliminary Investigation on Single Remote Sensing Image Inpainting Through a Modified GAN [paper] GAN-based
2018 ICCES 2018 Semantic Image Inpainting Vsing Self-Learning Encoder-Decoder and Adversarial Loss [paper] GAN-based
2018 ICNC-FSKD 2018 Image Inpainting Based on Generative Adversarial Networks [paper] GAN-based
2019 ICRA 2019 Empty Cities: Image Inpainting for a Dynamic-Object-Invariant Space [pdf]
2019 AAAI 2019 Video Inpainting by Jointly Learning Temporal Structure and Spatial Details [pdf] Video
2019 CVPR 2019 Pluralistic Image Completion [pdf] [code] [project] Diversity
2019 CVPR 2019 PEPSI: Fast Image Inpainting with Parallel Decoding Network [pdf] [code]
2019 CVPR 2019 Deep Reinforcement Learning of Volume-guided Progressive View Inpainting for 3D Point Scene Completion from a Single Depth Image [pdf]
2019 CVPR 2019 Foreground-aware Image Inpainting [pdf]
2019 CVPR 2019 Privacy Protection in Street-View Panoramas using Depth and Multi-View Imagery [pdf]
2019 CVPR 2019 Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting [pdf] [code] ATN
2019 CVPR 2019 Blind Visual Motif Removal from a Single Image [paper] CNN-based
2019 CVPR 2019 Deep Flow-Guided Video Inpainting [pdf] [project] Video
2019 CVPR 2019 Deep video inpainting [pdf] Video
2019 CVPR Workshop 2019 VORNet: Spatio-temporally Consistent Video Inpainting for Object Removal [pdf] Video
2019 TNNLS 2019 PEPSI++: Fast and Lightweight Network for Image Inpainting [pdf] GAN-based
2019 IJCAI 2019 MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting [pdf]
2019 IJCAI 2019 Generative Image Inpainting with Submanifold Alignment [pdf]
2019 IJCAI 2019 Coarse-to-Fine Image Inpainting via Region-wise Convolutionsand Non-Local Correlation [pdf]
2019 ACM MM 2019 Progressive Image Inpainting with Full-Resolution Residual Network [pdf] [code]
2019 ACM MM 2019 Deep Fusion Network for Image Completion [pdf] [code] CNN-based Fusion Block
2019 ACM MM 2019 GAIN: Gradient Augmented Inpainting Network for Irregular Holes [pdf] [blog]
2019 ACM MM 2019 Single-shot Semantic Image Inpainting with Densely Connected Generative Networks [pdf]
2019 ICCVW 2019 EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning [pdf] [code]
2019 ICCV 2019 Coherent Semantic Attention for Image Inpainting [pdf] [code] [blog] Attention
2019 ICCV 2019 StructureFlow: Image Inpainting via Structure-aware Appearance Flow [pdf] [code]
2019 ICCV 2019 Progressive Reconstruction of Visual Structure for Image Inpainting [pdf] [code]
2019 ICCV 2019 Localization of Deep Inpainting Using High-Pass Fully Convolutional Network [pdf]
2019 ICCV 2019 Image Inpainting with Learnable Bidirectional Attention Maps [pdf] [code]
2019 ICCV 2019 Free-Form Image Inpainting with Gated Convolution [pdf] [code] [project] [blog1] [blog2]
2019 ICCV 2019 CIIDefence: Defeating Adversarial Attacks by Fusing Class-specific Image Inpainting and Image Denoising [pdf]
2019 ICCV 2019 FiNet: Compatible and Diverse Fashion Image Inpainting [pdf] Fashion
2019 ICCV 2019 SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Color [pdf] [code] [blog] Face
2019 ICCV 2019 Human Motion Prediction via Spatio-Temporal Inpainting [pdf] [code] Motion
2019 ICCV 2019 Copy-and-Paste Networks for Deep Video Inpainting [pdf] Video
2019 ICCV 2019 Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN [pdf] [code] Video
2019 ICCV 2019 An Internal Learning Approach to Video Inpainting [pdf] Video
2019 ICCV 2019 Vision-Infused Deep Audio Inpainting [pdf] [code] Audio
2019 ACCESS 2019 Artist-Net: Decorating the Inferred Content With Unified Style for Image Inpainting [paper] CNN-based
2019 NPL 2019 An Improved Method for Semantic Image Inpainting with GANs: Progressive Inpainting [paper] GAN-based
2019 NPL 2019 Image inpainting: A review [paper] Deep learning
2019 PCS 2019 New Inpainting Algorithm Based on Simplified Context Encoders and Multi-Scale Adversarial Network [paper] GAN-based
2019 PRL 2019 Peeking behind objects: Layered depth prediction from a single image [paper] GAN-based
2019 VISAPP 2019 Semantic image inpainting through improved Wasserstein generative adversarial networks [paper] GAN-based
2020 AAAI 2020 Region Normalization for Image Inpainting [pdf] [code]
2020 AAAI 2020 Learning to Incorporate Structure Knowledge for Image Inpainting [pdf] [code] ATN
2020 WACV 2020 Evaluation of Image Inpainting for Classification and Retrieval [paper]
2020 ACCESS 2020 PiiGAN: Generative Adversarial Networks for Pluralistic Image Inpainting [paper][code] Diversity
2020 CVPR 2020 Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting [paper] [code] [code] Huawei
2020 CVPR 2020 UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation [paper] Diverse
2020 CVPR 2020 Recurrent Feature Reasoning for Image Inpainting [paper] [code] Recurrent
2020 CVPR 2020 Prior Guided GAN Based Semantic Inpainting [paper]
2020 CVPR 2020 Attentive Normalization for Conditional Image Generation [paper] [code] Attention
2020 CVPR 2020 Instance-aware Image Colorization [paper] [code] Colorization
2020 CVPR 2020 Intuitive, Interactive Beard and Hair Synthesis with Generative Models [paper] Image Editing
2020 CVPR 2020 Wish You Were Here: Context-Aware Human Generation [paper]
2020 CVPR 2020 Assessing Eye Aesthetics for Automatic Multi-Reference Eye In-Painting [paper] Eye
2020 CVPR 2020 3D Photography using Context-aware Layered Depth Inpainting [paper] [code] 3D
2020 CVPR 2020 FeatureFlow: Robust Video Interpolation via Structure-to-texture Generation [paper] [code] Video
2020 ECCV 2020 Rethinking image inpainting via a mutual encoder-decoder with feature equalization [paper] [official code] oral
2020 ECCV 2020 Learning Object Placement by Inpainting for Compositional Data Augmentation [paper]
2020 ECCV 2020 High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling [paper] [code]
2020 ECCV 2020 VCNet: A Robust Approach to Blind Image Inpainting [paper]
2020 ECCV 2020 Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes [paper]
2020 ECCV 2020 Short-Term and Long-Term Context Aggregation Network for Video Inpainting [paper] video
2020 ECCV 2020 DVI: Depth Guided Video Inpainting for Autonomous Driving [paper] video
2020 ECCV 2020 Learning Joint Spatial-Temporal Transformations for Video Inpainting [paper] video
2020 ECCVW 2020 (AIM 2020) AIM 2020 Challenge on Image Extreme Inpainting [paper] [code] [webpage] workshop
2020 ECCVW 2020 Image Fine-grained Inpainting [paper] [code] 1st
2020 ECCVW 2020 DeepGIN: Deep Generative Inpainting Networkfor Extreme Image Inpainting [paper] [code] 9th
2020 ACM MM 2020 Image Inpainting Based on Multi-frequency Probabilistic Inference Model [paper]
2021 WACV 2021 Hyperrealistic Image Inpainting With Hypergraphs [paper] [code]
2021 WACV 2021 Multi-Level Generative Chaotic Recurrent Network for Image Inpainting [paper]
2021 WACV 2021 R-MNet: A Perceptual Adversarial Network for Image Inpainting [paper] [code]

Inpainting Traditional Methods

Year Proceeding Title Comment
2000 SIGGRAPH 2000 Image Inpainting [pdf] [paper] Diffusion-based
2001 TIP 2001 Filling-in by joint interpolation of vector fields and gray levels [pdf] Diffusion-based
2001 CVPR 2001 Navier-stokes, fluid dynamics, and image and video inpainting [pdf]
2001 SIGGRAPH 2001 Image Quilting for Texture Synthesis and Transfer [pdf]
2001 SIGGRAPH 2001 Synthesizing Natural Textures [pdf]
2002 EJAM 2002 Digital inpainting based on the mumford–shah–euler image model [pdf] Diffusion-based
2003 CVPR 2003 Object removal by exemplar-based inpainting [pdf]
2003 TIP 2003 Simultaneous structure and texture image inpainting [pdf] Diffusion-based
2003 TIP 2003 Structure and Texture Filling-In of Missing Image Blocks in Wireless Transmission and Compression Applications [pdf]
2003 ICCV 2003 Learning How to Inpaint from Global Image Statistics [pdf] Diffusion-based
2003 TOG 2003 Fragment-based image completion [pdf] Patch-based
2004 TIP 2004 Region Filling and Object Removal by Exemplar-Based Image Inpainting [pdf] Patch-based; Inpainting order
2004 TPAMI 2004 Space-Time Video Completion [pdf]
2005 SIGGRAPH 2005 Image Completion with Structure Propagation [pdf] Patch-based
2006 ISCS 2006 Image Compression with Structure Aware Inpainting [pdf]
2006 JIVP 2006 Spatio-temporal consistent depth-image-based rendering using layered depth image and inpainting [paper] Object removal
2007 TOG 2007 Scene completion using millions of photographs [pdf]
2007 CSVT 2007 Image Compression With Edge-Based Inpainting [pdf] Diffusion-based
2007 TPAMI 2007 Space-Time Video Completion [pdf] video
2008 CVPR 2008 Summarizing Visual Data Using Bidirectional Similarity [pdf]
2009 SIGGRAPH 2009 PatchMatch: a randomized correspondence algorithm for structural image editing [pdf] Patch-based
2010 TIP 2010 Image inpainting by patch propagation using patch sparsity [pdf] Patch-based
2011 FTCGV 2011 Structured learning and prediction in computer vision [pdf]
2011 ICIP 2011 Examplar-based inpainting based on local geometry [pdf] Inpainting order
2012 TOG 2012 Combining inconsistent images using patch-based synthesis [pdf] Patch-based
2012 ACM TOG 2012 Image Melding: Combining Inconsistent Images using Patch-based Synthesis [pdf] Patch-based
2014 TOG 2014 Image completion using Planar structure guidance [pdf] Patch-based
2014 TIP 2014 Context-aware patch-based image inpainting using markov random field modeling [paper] [code] Patch-based
2014 TPAMI 2014 Image Completion Approaches Using the Statistics of Similar Patches [paper]
2014 TVCG 2014 High-Quality Real-Time Video Inpainting with PixMix [pdf] Video
2014 SIAM 2014 Video inpainting of complex scenes [pdf] Video
2015 TIP 2015 Annihilating Filter-Based Low-Rank Hankel Matrix Approach for Image Inpainting [pdf]
2015 TIP 2015 Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions [pdf]
2015 TVCG 2015 Diminished reality based on image inpainting considering background geometry [paper]
2015 JGO 2015 Fast algorithm for color texture image inpainting using the non-local ctv model [paper] Patch-based
2016 MTA 2016 Rate-distortion optimized image compression based on image inpainting [paper] Patch-based
2016 SIVP 2016 Domain-based structure-aware image inpainting [paper] Patch-based
2016 SC 2016 Image inpainting algorithm based on TV model and evolutionary algorithm [paper] Diffusion-based
2016 ICAC 2016 Image Inpainting Approaches – A Review [paper]
2016 TOG 2016 Temporally coherent completion of dynamic video [pdf] Video
2017 TVCG 2017 Patch-Based Image Inpainting via Two-Stage Low Rank Approximation [paper] Patch-based
2017 TIP 2017 Depth image inpainting: Improving low rank matrix completion with low gradient regularization [paper] [code] Patch-based
2017 MTA 2017 Exemplar-based image inpainting using svd-based approximation matrix and multi-scale analysis [paper] Patch-based
2017 EURASIP 2017 Damaged region filling and evaluation by symmetrical exemplar-based image inpainting for Thangka [paper] Patch-based
2017 TIFS 2017 Localization of diffusion-based inpainting in digital images [paper] Diffusion-based
2018 MTA 2018 Gradient-based low rank method and its application in image inpainting [paper] Patch-based
2018 MTA 2018 A novel patch matching algorithm for exemplar-based image inpainting [paper] Patch-based
2018 MTA 2018 A robust forgery detection algorithm for object removal by exemplar-based image inpainting [paper] Patch-based
2018 TIP 2018 Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering [paper] Patch-based
2018 TMM 2018 Structure-guided image inpainting using homography transformation [paper] Patch-based
2018 CC 2018 Damaged region filling by improved criminisi image inpainting algorithm for thangka [paper] Patch-based
2018 CC 2018 The research of image inpainting algorithm using self-adaptive group structure and sparse representation [paper] dictionary learning-based
2018 ACCESS 2018 Sparsity-based image inpainting detection via canonical correlation analysis with low-rank constraints [paper] Sparsity-based
2019 AJSE 2019 Image Inpainting Algorithm Based on Saliency Map and Gray Entropy [paper] Patch-based
2019 CSSP 2019 Image inpainting based on fractional-order nonlinear diffusion for image reconstruction [paper] Diffusion-based

ArXiv or Unpublished

Year Proceeding Title Comment
2018 arXiv:1801.07632 High Resolution Face Completion with Multiple Controllable Attributes via Fully End-to-End Progressive Generative Adversarial Networks [pdf]
2018 arXiv:1803.07422 Patch-Based Image Inpainting with Generative Adversarial Networks [pdf] [code]
2018 arXiv:1808.04432 X-GANs: Image Reconstruction Made Easy for Extreme Cases [pdf]
2018 arXiv:1811.03911 Unsupervised Learnable Sinogram Inpainting Network (SIN) for Limited Angle CT reconstruction [paper] CNN-based
2018 arXiv:1811.07104 On Hallucinating Context and Background Pixels from a Face Mask using Multi-scale GANs [pdf]
2018 arXiv:1811.09012 Multi-View Inpainting for RGB-D Sequence [pdf]
2018 arXiv:1812.01458 Deep Inception Generative network for Cognitive Image Inpainting [pdf]
2018 arXiv:1808.08483 Painting Outside the Box: Image Outpainting with GANs [paper] GAN-based
2019 arXiv:1901.03396 Detecting Overfitting of Deep Generative Networks via Latent Recovery [pdf]
2019 arXiv:1902.00301 Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolution [paper] CNN-based
2019 arXiv:1902.09225 Harmonizing Maximum Likelihood with GANs for Multimodal Conditional Generation [pdf]
2019 arXiv:1903.00450 Multi-Object Representation Learning with Iterative Variational Inference [pdf]
2019 arXiv:1903.04842 Unsupervised motion saliency map estimation based on optical flow inpainting [pdf]
2019 arXiv:1903.10885 Learning Quadrangulated Patches For 3D Shape Processing [pdf]
2019 arXiv:1904.10795 Graph-based Inpainting for 3D Dynamic Point Clouds [pdf] Point Cloud
2019 arXiv:1905.02882 Frame-Recurrent Video Inpainting by Robust Optical Flow Inference [pdf] Video
2019 arXiv:1905.02949 Deep Blind Video Decaptioning by Temporal Aggregation and Recurrence [pdf] Video
2019 arXiv:1905.12384 Coherent Semantic Attention for Image Inpainting [paper] CNN-based
2019 arXiv:1905.13066 Align-and-Attend Network for Globally and Locally Coherent Video Inpainting [pdf] Video
2019 arXiv:1906.00884 Fashion Editing with Multi-scale Attention Normalization [pdf]
2019 arXiv:1912.01834 Diversity-Generated Image Inpainting with Style Extraction [paper] [code] GAN-based
2019 arXiv:1912.11711 Controllable and Progressive Image Extrapolation [paper] GAN-based
2019 arXiv:1912.10960v2 Image Outpainting and Harmonization using Generative Adversarial Networks [paper] [code] GAN-based
2020 arXiv:2001.04568 180-degree Outpainting from a Single Image [paper] GAN-based

Interesting Applications of GAN

Year Proceeding Title Comment
2019 arXiv:1903.10146v1 PI-REC: Progressive Image Reconstruction Network With Edge and ColorDomain [paper] [code] edge2image

The Survey of GAN

Year Proceeding Title Comment
2020 arXiv:1906.01529v5 Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy [paper] Overview
2019 arXiv:1809.06222v3 GANs for Medical Image Analysis [paper] [link] Medical

Related Link

CVPR 2020

CVPR 2020 Workshops

CVPR 2019

ICCV 2019

ECCV 2018-2020

ECCV 2018

ECCV 90-2018

NeurlPS 1988-2019

ACM MM 2020

ICLR 2019

ICML 2019

AAAI 2019

WACV 2021

WACV 2020

IJCAI 2019

ACL 2019

Extrapolation arXiv paper search

Outpainting arXiv paper search

Inpainting arXiv paper search