A curated list of inpainting papers and resources, inspired by awesome-computer-vision.
- Image inpainting. Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C.
In SIGGRAPH 2000 - Simultaneous structure and texture image inpainting. Bertalmio, M., Vese, L., Sapiro, G., & Osher, S.
In TIP 2003 - Region filling and object removal by exemplar-based image inpainting. Criminisi, A., Pérez, P., & Toyama, K.
In TIP 2004 - Image completion with structure propagation. Sun, J., Yuan, L., Jia, J., & Shum, H. Y.
In TOG 2005 - Image completion using planar structure guidance. Huang, J. B., Kang, S. B., Ahuja, N., & Kopf, J.
In TOG 2014[code] [project] - PatchMatch: A randomized correspondence algorithm for structural image editing. Connelly Barnes, Eli Shechtman, Adam Finkelstein, Dan B Goldman.
In TOG 2009, [project] - Deep Image Prior. Dmitry Ulyanov, Andrea Vedaldi, Victor Lempitsky.
In IJCV 2020, [project] [code] [demo]
- Shepard convolutional neural networks. Ren, J. S., Xu, L., Yan, Q., & Sun, W.
In NeurIPS 2015[code] - Context encoders: Feature learning by inpainting. Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., & Efros, A. A.
In CVPR 2016. [code] - Globally and locally consistent image completion. Iizuka, S., Simo-Serra, E., & Ishikawa, H. (2017).
In TOG 2017[code] [project] - High-resolution image inpainting using multi-scale neural patch synthesis. Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., & Li, H.
In CVPR 2017[code] - Generative face completion. Li, Y., Liu, S., Yang, J., & Yang, M. H.
In CVPR 2017[code] - Semantic image inpainting with deep generative models. Yeh, R. A., Chen, C., Yian Lim, T., Schwing, A. G., Hasegawa-Johnson, M., & Do, M. N.
In CVPR 2017[code] [project] - Generative image inpainting with contextual attention. Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., & Huang, T. S.
In CVPR 2018[code] [project] - Natural and effective obfuscation by head inpainting. Sun Qianru et al.
In CVPR 2018 - Eye in-painting with exemplar generative adversarial networks. Dolhansky, B., & Canton Ferrer, C.
In CVPR 2018[project] [code] - Uv-gan: Adversarial facial uv map completion for pose-invariant face recognition. Deng, J., Cheng, S., Xue, N., Zhou, Y., & Zafeiriou, S.
In CVPR 2018 - Disentangling Structure and Aesthetics for Style-aware Image Completion. Gilbert, A., Collomosse, J., Jin, H., & Price, B.
In CVPR 2018 - Image inpainting for irregular holes using partial convolutions. Liu, G., Reda, F. A., Shih, K. J., Wang, T. C., Tao, A., & Catanzaro, B.
In ECCV 2018[project] - Contextual-based image inpainting: Infer, match, and translate. Song, Y., Yang, C., Lin, Z., Liu, X., Huang, Q., Li, H., & Jay Kuo, C. C.
In ECCV 2018 - Shift-net: Image inpainting via deep feature rearrangement. Yan, Z., Li, X., Li, M., Zuo, W., & Shan, S.
In ECCV 2018[code] - Image Inpainting via Generative Multi-column Convolutional Neural Networks. Wang, Y., Tao, X., Qi, X., Shen, X., & Jia, J.
In NeurIPS 2018[code] - SPG-Net: Segmentation prediction and guidance network for image inpainting. Song, Y., Yang, C., Shen, Y., Wang, P., Huang, Q., & Kuo, C. C. J.
In BMVC 2018 - Structural inpainting. Vo, H. V., Duong, N. Q., & Pérez, P.
In MM 2018 - Semantic Image Inpainting with Progressive Generative Networks. Zhang, H., Hu, Z., Luo, C., Zuo, W., & Wang, M.
In MM 2018[code] - Face Completion with Semantic Knowledge and Collaborative Adversarial Learning. Liao, H., Funka-Lea, G., Zheng, Y., Luo, J., & Zhou, S. K.
In ACCV 2018 - Edge-Aware Context Encoder for Image Inpainting. Liao, L., Hu, R., Xiao, J., & Wang, Z.
In ICASPP 2018 - Faceshop: Deep sketch-based face image editing. Portenier, T., Hu, Q., Szabó, A., Bigdeli, S. A., Favaro, P., & Zwicker, M.
In TOG 2018 - High resolution face completion with multiple controllable attributes via fully end-to-end progressive generative adversarial networks. Chen, Z., Nie, S., Wu, T., & Healey, C. G.
In Arxiv 2018 - On Hallucinating Context and Background Pixels from a Face Mask using Multi-scale GANs. Banerjee, S., Scheirer, W. J., Bowyer, K. W., & Flynn, P. J.
In Arxiv 2018 - Pluralistic Image Completion. Zheng, C., Cham, T. J., & Cai, J.
In CVPR 2019[code] [project] - Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting. Zeng et al.,
In CVPR 2019[code] - Foreground-aware Image Inpainting. Xiong et al.,
In CVPR 2019 - Deep Reinforcement Learning of Volume-guided Progressive View Inpainting for 3D Point Scene Completion from a Single Depth Image. Han, X., Zhang, Z., Du, D., Yang, M., Yu, J., Pan, P., ... & Cui, S.
In CVPR 2019 - PEPSI: Fast Image Inpainting With Parallel Decoding Network. CVPR (pp. 11360-11368). Sagong et al.
In CVPR 2019 - Coordinate-Based Texture Inpainting for Pose-Guided Human Image Generation. Grigorev et al. CVPR2019.
- Deep Inception Generative Network for Cognitive Image Inpainting. Xiao, Q., Li, G., & Chen, Q.
In Arxiv 2019 - Detecting Overfitting of Deep Generative Networks via Latent Recovery. Webster, R., Rabin, J., Simon, L., & Jurie, F.
In Arxiv 2019 - SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Color. Jo, Y., & Park, J. (2019).
In Arxiv 2019[code] - Deep Fusion Network for Image Completion. Hong et al.
In Arxiv 2019[code] - PEPSI++: Fast and Lightweight Network for Image Inpainting. Shin et al.
In Arxiv 2019 - Generative Image Inpainting with Submanifold Alignment Li et al.
In IJCAI 2019 - MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting. Wang, N., Li, J., Zhang, L., & Du, B.
In IJCAI 2019 - Coarse-to-Fine Image Inpainting via Region-wise Convolutions and Non-Local Correlation. Ma, Y., Liu, X., Bai, S., Wang, L., He, D., & Liu, A.
In IJCAI 2019 - StructureFlow: Image Inpainting via Structure-aware Appearance Flow, Yurui Ren, Xiaoming Yu, Ruonan Zhang, Thomas H. Li, Shan Liu, Ge Li.
In ICCV 2019[code] - Image Inpainting with Learnable Bidirectional Attention Maps, Xie et al.
In ICCV 2019[code] - Coherent Semantic Attention for Image Inpainting, Liu et al.
In ICCV 2019[code] - EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning. Nazeri, K., Ng, E., Joseph, T., Qureshi, F., & Ebrahimi, M.
In ICCVW 2019[code] - Free-form image inpainting with gated convolution. Yu et al.
In ICCV 2019[project] - Region Normalization for Image Inpainting. Tao et al.
In AAAI 2020[code] - Learning to Incorporate Structure Knowledge for Image Inpainting, Yang et al.
In AAAI 2020[code] - Prior Guided GAN Based Semantic Inpainting, Lahiri1 et al.
In CVPR 2020 - UCTGAN: Diverse Image Inpainting based on Unsupervised Cross-Space Translation, Zhao et al.
In CVPR 2020 - Recurrent Feature Reasoning for Image Inpainting, Li et al.
In CVPR 2020[code] - Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting, Yi et al.,
In CVPR 2020[code] - 3D Photography using Context-aware Layered Depth Inpainting, Shih et al.
In CVPR 2020[demo] [code] - Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations, Liu et al.
In ECCV 2020[code] - Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes, Liao et al.
In ECCV 2020 - VCNet: A Robust Approach to Blind Image Inpainting, Wang et al.
In ECCV 2020[code] - High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling, Zeng et al.
In ECCV 2020[project] - Image Inpainting with Onion Convolution, Shant et al.,
In ACCV 2020 - Hyperrealistic Image Inpainting with Hypergraphs, Wadhwa et al.,
In WACV 2021[code] - Image Inpainting with External-internal Learning and Monochromic Bottleneck, Wang et al.,
In CVPR 2021[code] [project] - Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE, Peng et al.,
In CVPR 2021[code] - PD-GAN: Probabilistic Diverse GAN for Image Inpainting, Liu et al.,
In CVPR 2021[code] - Image Inpainting Guided by Coherence Priors of Semantics and Textures,
In CVPR 2021 - TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformations, Zhou et al.,
In CVPR 2021[code] [project] - FaceInpainter: High Fidelity Face Adaptation to Heterogeneous Domains, Li et al.,
In CVPR 2021 - Large Scale Image Completion via Co-Modulated Generative Adversarial Networks, Zhao et al.,
In ICLR 2021[code] - Image Inpainting via Conditional Texture and Structure Dual Generation, Guo et al.,
In ICCV 2021[code] - CR-Fill: Generative Image Inpainting With Auxiliary Contextual Reconstruction, Zeng et al.,
In ICCV 2021[code] - Parallel Multi-Resolution Fusion Network for Image Inpainting, Wang et al.,
In ICCV 2021 - WaveFill: A Wavelet-Based Generation Network for Image Inpainting, Yu et al.,
In ICCV 2021 - SLIDE: Single Image 3D Photography With Soft Layering and Depth-Aware Inpainting, Kaeser et al.,
In ICCV 2021[project] - Distillation-Guided Image Inpainting, Suin et al.,
In ICCV 2021 - High-Fidelity Pluralistic Image Completion With Transformers, Wan et al.,
In ICCV 2021[code] [project] - Learning a Sketch Tensor Space for Image Inpainting of Man-Made Scenes, Cao et al.,
In ICCV 2021[project] [code] - Learning High-Fidelity Face Texture Completion Without Complete Face Texture, Kim et al.,
In ICCV 2021 - Dual-path Image Inpainting with Auxiliary GAN Inversion, Wang et al.,
In CVPR 2022 - MAT: Mask-Aware Transformer for Large Hole Image Inpainting, Li et al.,
In CVPR 2022[code] - RePaint: Inpainting using Denoising Diffusion Probabilistic Models, Lugmayr et al.,
In CVPR 2022[code] - MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpainting, Li et al.,
In CVPR 2022[code] - Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding, Dong et al.,
In CVPR 2022[code] - Reduce Information Loss in Transformers for Pluralistic Image Inpainting, Liu et al., In CVPR 2022 [code]
- Navier-stokes, fluid dynamics, and image and video inpainting. Bertalmio, M., Bertozzi, A. L., & Sapiro, G.
In CVPR 2001(Vol. 1, pp. I-I). IEEE. - Video inpainting of occluding and occluded objects. Patwardhan, K. A., Sapiro, G., & Bertalmio, M.
In ICIP 2005(Vol. 2, pp. II-69). IEEE. - Full-frame video stabilization with motion inpainting. Matsushita, Y., Ofek, E., Ge, W., Tang, X., & Shum, H. Y.
In TPAMI 2006, (7), 1150-1163. [project] - Video completion by motion field transfer. Shiratori, T., Matsushita, Y., Tang, X., & Kang, S. B. (2006, June).
In CVPR 2006(Vol. 1, pp. 411-418). [project] - Space-time completion of video. Wexler, Y., Shechtman, E., & Irani, M.
In TPAMI 2007, (3), 463-476. [project] - Video inpainting under constrained camera motion. Patwardhan, K. A., Sapiro, G., & Bertalmío, M.
In TIP 2007, 16(2), 545-553. - How not to be seen-object removal from videos of crowded scenes. Granados, M., Tompkin, J., Kim, K., Grau, O., Kautz, J., & Theobalt, C.
In Computer Graphics Forum 2012(Vol. 31, No. 2pt1, pp. 219-228). [project] - Background inpainting for videos with dynamic objects and a free-moving camera. Springer, Berlin, Heidelberg. Granados, M., Kim, K. I., Tompkin, J., Kautz, J., & Theobalt, C.
In ECCV 2012. [project] - Video inpainting of complex scenes. Newson, A., Almansa, A., Fradet, M., Gousseau, Y., & Pérez, P.
In SIAM Journal on Imaging Sciences 2014, 7(4), 1993-2019. [project] - Video inpainting with short-term windows: application to object removal and error concealment. Ebdelli, M., Le Meur, O., & Guillemot, C.
In TIP 2015, 24(10), 3034-3047. - Temporally coherent completion of dynamic video. Huang, J. B., Kang, S. B., Ahuja, N., & Kopf, J.
In TOG 2016. [project] [code]
- Video inpainting by jointly learning temporal structure and spatial details. Wang, C., Huang, H., Han, X., & Wang, J.
In AAAI 2019 - Deep Flow-Guided Video Inpainting. Xu, R., Li, X., Zhou, B., & Loy, C. C.
In CVPR 2019[code] [project] - Deep Video Inpainting. Kim, D., Woo, S., Lee, J. Y., & Kweon, I. S.
In CVPR 2019[code] [project] - Deep Blind Video Decaptioning by Temporal Aggregation and Recurrence. Kim, D., Woo, S., Lee, J. Y., & Kweon, I. S.
In CVPR 2019[project] - VORNet: Spatio-temporally Consistent Video Inpainting for Object Removal
Ya-Liang Chang, Zhe Yu Liu, Winston Hsu.
In CVPRW 2019[code] - Learnable Gated Temporal Shift Module for Deep Video Inpainting Ya-Liang Chang, Zhe Yu Liu, Kuan-Ying Lee, Winston Hsu.
In BMVC 2019[code] - Align-and-Attend Network for Globally and Locally Coherent Video Inpainting. Woo, S., Kim, D., Park, K., Lee, J. Y., & Kweon, I. S.
In Arxiv 2019 - Frame-Recurrent Video Inpainting by Robust Optical Flow Inference Yifan Ding, Chuan Wang, Haibin Huang, Jiaming Liu, Jue Wang, Liqiang Wang.
In Arxiv 2019 - Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN Chang et al.,
In ICCV 2019[code] - Onion-Peel Networks for Deep Video Completion, Oh et al.,
In ICCV 2019[project] [code] - Copy-and-Paste Networks for Deep Video Inpainting, Lee et al.,
In ICCV 2019[code][project] - An Internal Learning Approach to Video Inpainting, Zhang et al.,
In ICCV 2019[project] - Short-Term and Long-Term Context Aggregation Network for Video Inpainting, Li et al.
In ECCV 2020 - Proposal-based Video Completion, Hu et al.
In ECCV 2020 - DVI: Depth Guided Video Inpainting for Autonomous Driving, Liao et al.
In ECCV 2020[project] - Learning Joint Spatial-Temporal Transformations for Video Inpainting, Zeng et al.,
In ECCV 2020[project] - Flow-edge Guided Video Completion, Gao et al.
In ECCV 2020[project] - Progressive Temporal Feature Alignment Network for Video Inpainting, Zou et al.,
In CVPR 2021[code] - Internal Video Inpainting by Implicit Long-range Propagation, ouyang et al.,
In ICCV 2021[project] [code] - FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting, Liu et al.,
In ICCV 2021[code] - Flow-Guided Video Inpainting With Scene Templates, Lao et al.,
In ICCV 2021[code] - Frequency-Aware Spatiotemporal Transformers for Video Inpainting Detection, Yu et al.,
In ICCV 2021 - Occlusion-Aware Video Object Inpainting, ke et al.,
In ICCV 2021[project] - Towards An End-to-End Framework for Flow-Guided Video Inpainting, Li et al.,
In CVPR 2022[code] - Inertia-Guided Flow Completion and Style Fusion for Video Inpainting, Zhang et al.,
In CVPR 2022 - DLFormer: Discrete Latent Transformer for Video Inpainting, Ren et al.,
In CVPR 2022 - The DEVIL is in the Details: A Diagnostic Evaluation Benchmark for Video Inpainting, Szeto et al.,
In CVPR 2022[code]