3D face reconstruction paper list

Paper list of some 3D face reconstruction. To be continued.

CVPR

2023

  • MEGANE: Morphable Eyeglass and Avatar Network
    Junxuan Li, Shunsuke Saito, Tomas Simon, Stephen Lombardi, Hongdong Li, Jason Saragih
    [arxiv][page]

  • Towards Effective Adversarial Textured 3D Meshes on Physical Face Recognition
    Xiao Yang, Chang Liu, Longlong Xu, Yikai Wang, Yinpeng Dong, Ning Chen, Hang Su, Jun Zhu
    [arxiv]

  • Robust Model-based Face Reconstruction through Weakly-Supervised Outlier Segmentation
    Chunlu Li, Andreas Morel-Forster, Thomas Vetter, Bernhard Egger, Adam Kortylewski
    [arxiv][code]

  • Learning a 3D Morphable Face Reflectance Model from Low-cost Data
    Yuxuan Han, Zhibo Wang, Feng Xu
    [arxiv][code][page]

  • A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images
    Biwen Lei, Jianqiang Ren, Mengyang Feng, Miaomiao Cui, Xuansong Xie
    [arxiv][code][page]

  • Learning Neural Parametric Head Models
    Simon Giebenhain, Tobias Kirschstein, Markos Georgopoulos, Martin Rünz, Lourdes Agapito, Matthias Nießner
    [arxiv][page]

  • High-Res Facial Appearance Capture from Polarized Smartphone Images
    Dejan Azinović, Olivier Maury, Christophe Hery, Mathias Nießner, Justus Thies
    [arxiv][page]

  • FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction
    Haoran Bai, Di Kang, Haoxian Zhang, Jinshan Pan, Linchao Bao
    [arxiv][code]

2022

  • 3D Shape Reconstruction from 2D Images with Disentangled Attribute Flow
    Xin Wen, Junsheng Zhou, Yu-Shen Liu, Zhen Dong, Zhizhong Han
    [arxiv][code]

  • Neural Head Avatars from Monocular RGB Videos
    Philip-William Grassal Malte Prinzler, Titus Leistner, Carsten Rother, Matthias Nießner, Justus Thies
    [arxiv][page]

  • I M Avatar: Implicit Morphable Head Avatars from Videos
    Yufeng Zheng, Victoria Fernández Abrevaya, Marcel C. Bühler, Xu Chen, Michael J. Black, Otmar Hilliges
    [arxiv][page]

  • FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset
    Lizhen Wang, Zhiyuan Chen, Tao Yu, Chenguang Ma, Liang Li, Yebin Liu
    [arxiv][code]

  • 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces
    Simone Foti, Bongjin Koo, Danail Stoyanov, Matthew J. Clarkson
    [arxiv][code]

  • EMOCA: Emotion Driven Monocular Face Capture and Animation
    Radek Danecek, Michael J. Black, Timo Bolkart
    [arxiv][code][page]

  • ImFace: A Nonlinear 3D Morphable Face Model with Implicit Neural Representations
    Mingwu Zheng, Hongyu Yang, Di Huang, Liming Chen
    [arxiv][code]

  • Generating Diverse 3D Reconstructions from a Single Occluded Face Image
    Rahul Dey, Vishnu Naresh Boddeti
    [arxiv][code]

  • DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Image
    Tetiana Martyniuk, Orest Kupyn, Yana Kurlyak, Igor Krashenyi, Jiři Matas, Viktoriia Sharmanska
    [arxiv][code]

2021

  • Inverting Generative Adversarial Renderer for Face Reconstruction
    Jingtan Piao, Keqiang Sun, KwanYee Lin, Quan Wang, Hongsheng Li
    [arxiv]

  • Learning Complete 3D Morphable Face Models from Images and Videos
    Mallikarjun B R, Ayush Tewari, Hans-Peter Seidel, Mohamed Elgharib, Christian Theobalt
    [arxiv][page]

  • Learning to Aggregate and Personalize 3D Face from In-the-Wild Photo Collection
    Zhenyu Zhang, Yanhao Ge, Renwang Chen, Ying Tai, Yan Yan, Jian Yang, Chengjie Wang, Jilin Li, Feiyue Huang
    [arxiv][code]

  • Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement
    Huiwen Luo, Koki Nagano, Han-Wei Kung, Mclean Goldwhite, Qingguo Xu, Zejian Wang, Lingyu Wei, Liwen Hu, Hao Li
    [arxiv]

  • OSTeC: One-Shot Texture Completion
    Baris Gecer, Jiankang Deng, Stefanos Zafeiriou
    [arxiv][code]

  • Pixel Codec Avatars
    Shugao Ma, Tomas Simon, Jason Saragih, Dawei Wang, Yuecheng Li, Fernando De La Torre, Yaser Sheikh
    [arxiv]

  • Riggable 3D Face Reconstruction via In-Network Optimization
    Ziqian Bai, Zhaopeng Cui, Xiaoming Liu, Ping Tan
    [arxiv][code]

  • Self-Supervised 3D Mesh Reconstruction From Single Images
    Tao Hu, Liwei Wang, Xiaogang Xu, Shu Liu, Jiaya Jia
    [pdf][code]

  • i3DMM: Deep Implicit 3D Morphable Model of Human Heads
    Tarun Yenamandra, Ayush Tewari, Florian Bernard, Hans-Peter Seidel, Mohamed Elgharib, Daniel Cremers, Christian Theobalt
    [arxiv][page][code]

  • High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation
    Lele Chen, Chen Cao, Fernando De la Torre, Jason Saragih, Chenliang Xu, Yaser Sheikh
    [arxiv][page]

  • Learning Feature Aggregation for Deep 3D Morphable Models
    Zhixiang Chen, Tae-Kyun Kim
    [arxiv][code]

2020

  • A Morphable Face Albedo Model
    William A. P. Smith, Alassane Seck, Hannah Dee, Bernard Tiddeman, Joshua B. Tenenbaum, Bernhard Egger
    [arxiv][code]

  • AvatarMe: Realistically Renderable 3D Facial Reconstruction" In-the-Wild"
    Alexandros Lattas, Stylianos Moschoglou, Baris Gecer, Stylianos Ploumpis, Vasileios Triantafyllou, Abhijeet Ghosh, Stefanos Zafeiriou
    [arxiv][code]

  • Cross-modal Deep Face Normals with Deactivable Skip Connections
    Victoria Fernandez Abrevaya, Adnane Boukhayma, Philip H. S. Torr, Edmond Boyer
    [arxiv][code]

  • FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction
    Haotian Yang, Hao Zhu, Yanru Wang, Mingkai Huang, Qiu Shen, Ruigang Yang, Xun Cao
    [arxiv][code]

  • ReDA:Reinforced Differentiable Attribute for 3D Face Reconstruction
    Wenbin Zhu, HsiangTao Wu, Zeyu Chen, Noranart Vesdapunt, Baoyuan Wang
    [pdf]

  • Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks
    Jiangke Lin, Yi Yuan, Tianjia Shao, Kun Zhou
    [arxiv][code]

  • Uncertainty-Aware Mesh Decoder for High Fidelity 3D Face Reconstruction
    Gun-Hee Lee, Seong-Whan Lee
    [pdf]

  • Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wild
    Shangzhe Wu, Christian Rupprecht, Andrea Vedaldi
    [arxiv][page][code]

  • Deep 3D Portrait from a Single Image
    Sicheng Xu, Jiaolong Yang, Dong Chen, Fang Wen, Yu Deng, Yunde Jia, Xin Tong
    [arxiv][code]

  • Learning Formation of Physically-Based Face Attributes
    Ruilong Li, Karl Bladin, Yajie Zhao, Chinmay Chinara, Owen Ingraham, Pengda Xiang, Xinglei Ren, Pratusha Prasad, Bipin Kishore, Jun Xing, Hao Li
    [arxiv]

2019

  • Combining 3D Morphable Models: A Large scale Face-and-Head Model
    Stylianos Ploumpis, Haoyang Wang, Nick Pears, William A. P. Smith, Stefanos Zafeiriou
    [arxiv][code]

  • FML: Face Model Learning From Videos
    Ayush Tewari, Florian Bernard, Pablo Garrido, Gaurav Bharaj, Mohamed Elgharib, Hans-Peter Seidel, Patrick Perez, Michael Zollhofer, Christian Theobalt
    [arxiv]

  • GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstruction
    Baris Gecer, Stylianos Ploumpis, Irene Kotsia, Stefanos Zafeiriou
    [arxiv][code]

  • Learning to Regress 3D Face Shape and Expressionfrom an Image without 3D Supervision
    Soubhik Sanyal, Timo Bolkart, Haiwen Feng, Michael J. Black
    [arxiv][code][page]

  • MMFace: A Multi-Metric Regression Network for Unconstrained Face Reconstruction
    Hongwei Yi, Chen Li, Qiong Cao, Xiaoyong Shen, Sheng Li, Guoping Wang, Yu-Wing Tai
    [pdf]

  • MVF-Net: Multi-View 3D Face Morphable Model Regression
    Fanzi Wu, Linchao Bao, Yajing Chen, Yonggen Ling, Yibing Song, Songnan Li, King Ngi Ngan, Wei Liu
    [arxiv]

  • Towards High-fidelity Nonlinear 3D Face Morphable Model
    Luan Tran, Feng Liu, Xiaoming Liu
    [arxiv][page][code]

2018

  • Disentangling Features in 3D Face Shapes for Joint Face Reconstruction and Recognition
    Feng Liu, Ronghang Zhu, Dan Zeng, Qijun Zhao, Xiaoming Liu
    [arxiv]

  • Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hz
    Ayush Tewari, Michael Zollhöfer, Pablo Garrido, Florian Bernard, Hyeongwoo Kim, Patrick Pérez, Christian Theobalt
    [arxiv][page]

  • Unsupervised Training for 3D Morphable Model Regression
    Kyle Genova, Forrester Cole, Aaron Maschinot, Aaron Sarna, Daniel Vlasic, William T. Freeman
    [arxiv][code]

  • Nonlinear 3D Face Morphable Model
    Luan Tran, Xiaoming Liu
    [arxiv][page][code]

2017

  • Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Network
    Anh Tuan Tran, Tal Hassner, Iacopo Masi, Gerard Medioni
    [arxiv][code]

2016

  • A 3D Morphable Model learnt from 10,000 faces
    James Booth, Anastasios Roussos, Stefanos Zafeiriou, Allan Ponniah, David Dunaway
    [pdf][code]

-2015

  • Optimal Step Nonrigid ICP Algorithms for Surface Registration
    Brian Amberg, Sami Romdhani, Thomas Vetter
    [pdf]

CVPRW

2020

  • Semi-supervised 3D Face Representation Learning from Unconstrained Photo Collections
    Zhongpai Gao, Juyong Zhang, Yudong Guo, Chao Ma, Guangtao Zhai, Xiaokang Yang
    [pdf]

2019

  • Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set
    Yu Deng, Jiaolong Yang, Sicheng Xu, Dong Chen, Yunde Jia, Xin Tong
    [arxiv][code]

  • Real-time Facial Surface Geometry from Monocular Video on Mobile GPUs
    Yury Kartynnik, Artsiom Ablavatski, Ivan Grishchenko, Matthias Grundmann
    [arxiv][code]

ICCV

2021

  • H3D-Net: Few-Shot High-Fidelity 3D Head Reconstruction
    Eduard Ramon, Gil Triginer, Janna Escur, Albert Pumarola, Jaime Garcia, Xavier Giro-i-Nieto, Francesc Moreno-Noguer
    [arxiv][code]

  • Self-Supervised 3D Face Reconstruction via Conditional Estimation
    Yandong Wen, Weiyang Liu, Bhiksha Raj, Rita Singh
    [arxiv]

  • Topologically Consistent Multi-View Face Inference Using Volumetric Sampling
    Tianye Li, Shichen Liu, Timo Bolkart, Jiayi Liu, Hao Li, Yajie Zhao
    [arxiv][page][code]

  • Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing
    Abdallah Dib, Cedric Thebault, Junghyun Ahn, Philippe-Henri Gosselin, Christian Theobalt, Louis Chevallier
    [arxiv]

  • ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generators
    Qixing Huang, Xiangru Huang, Bo Sun, Zaiwei Zhang, Junfeng Jiang, Chandrajit Bajaj
    [arxiv][code]

  • Learning High-Fidelity Face Texture Completion without Complete Face Texture
    Jongyoo Kim, Jiaolong Yang, Xin Tong
    [pdf]

  • Fake It Till You Make It: Face analysis in the wild using synthetic data alone
    Erroll Wood, Tadas Baltrušaitis, Charlie Hewitt, Sebastian Dziadzio, Matthew Johnson, Virginia Estellers, Thomas J. Cashman, Jamie Shotton
    [arxiv][page]

2019

  • DF2Net: A Dense-Fine-Finer Network for Detailed 3D Face Reconstruction
    Xiaoxing Zeng, Xiaojiang Peng, Yu Qiao
    [pdf][code]

  • Photo-Realistic Facial Details Synthesis from Single Image
    Anpei Chen, Zhang Chen, Guli Zhang, Ziheng Zhang, Kenny Mitchell, Jingyi Yu
    [arxiv][code]

  • Semi-Supervised Monocular 3D Face Reconstruction With End-to-End Shape-Preserved Domain Transfer
    Jingtan Piao, Chen Qian, Hongsheng Li
    [pdf]

  • Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning
    Shichen Liu, Tianye Li, Weikai Chen, Hao Li
    [arxiv][code]

  • Neural 3D Morphable Models: Spiral Convolutional Networks for 3D Shape Representation Learning and Generation
    Giorgos Bouritsas, Sergiy Bokhnyak, Stylianos Ploumpis, Michael Bronstein, Stefanos Zafeiriou
    [arxiv][code]

  • A Decoupled 3D Facial Shape Model by Adversarial Training
    Victoria Fernandez Abrevaya, Adnane Boukhayma, Stefanie Wuhrer, Edmond Boyer
    [arxiv]

2017

  • MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction
    Ayush Tewari, Michael Zollhöfer, Hyeongwoo Kim, Pablo Garrido, Florian Bernard, Patrick Pérez, Christian Theobalt
    [arxiv]

  • Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation
    Matan Sela, Elad Richardson, Ron Kimmel
    [arxiv][code]

  • A 3D Morphable Model of Craniofacial Shape and Texture Variation
    Hang Dai, Nick Pears, William Smith, Christian Duncan
    [pdf][page]

  • Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression
    Aaron S. Jackson, Adrian Bulat, Vasileios Argyriou, Georgios Tzimiropoulos
    [arxiv][page][code]

ICCVW

2019

  • Dual Attention MobDenseNet(DAMDNet) for Robust 3D Face Alignment
    Lei Jiang, Xiao-Jun Wu, Josef Kittler
    [arxiv][code]

ECCV

2022

  • REALY: Rethinking the Evaluation of 3D Face Reconstruction
    Zenghao Chai, Haoxian Zhang, Jing Ren, Di Kang, Zhengzhuo Xu, Xuefei Zhe, Chun Yuan, Linchao Bao
    [arxiv][code][page]

  • Towards Metrical Reconstruction of Human Faces
    Wojciech Zielonka, Timo Bolkart, Justus Thies
    [arxiv][code][page]

  • Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation
    Jingwang Ling, Zhibo Wang, Ming Lu, Quan Wang, Chen Qian, Feng Xu
    [arxiv][code]

  • 3D face reconstruction with dense landmarks
    Erroll Wood, Tadas Baltrusaitis, Charlie Hewitt, Matthew Johnson, Jingjing Shen, Nikola Milosavljevic, Daniel Wilde, Stephan Garbin, Chirag Raman, Jamie Shotton, Toby Sharp, Ivan Stojiljkovic, Tom Cashman, Julien Valentin
    [arxiv][page]

  • MoFaNeRF: Morphable Facial Neural Radiance Field
    Yiyu Zhuang, Hao Zhu, Xusen Sun, Xun Cao
    [arxiv][code]

  • Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguation
    Haiwen Feng, Timo Bolkart, Joachim Tesch, Michael J. Black, Victoria Abrevaya
    [arxiv][code][page]

2020

  • Beyond 3DMM Space: Towards Fine-grained 3D Face Reconstruction
    Xiangyu Zhu, Fan Yang, Di Huang, Chang Yu, Hao Wang, Jianzhu Guo, Zhen Lei, Stan Z. Li
    [pdf][page]

  • Personalized Face Modeling for Improved Face Reconstruction and Motion Retargeting
    Bindita Chaudhuri, Noranart Vesdapunt, Linda Shapiro, Baoyuan Wang
    [arxiv][page]

  • Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency
    Jiaxiang Shang, Tianwei Shen, Shiwei Li, Lei Zhou, Mingmin Zhen, Tian Fang, Long Quan
    [arxiv][code]

  • Towards Fast, Accurate and Stable 3D Dense Face Alignment
    Jianzhu Guo, Xiangyu Zhu, Yang Yang, Fan Yang, Zhen Lei, Stan Z. Li
    [arxiv][code]

  • Inequality-Constrained and Robust 3D Face Model Fitting
    Evangelos Sariyanidi, Casey J. Zampella, Robert T. Schultz, Birkan Tunc
    [pdf][code]

  • “Look Ma, no landmarks!” – Unsupervised, model-based dense face alignment
    Tatsuro Koizumi and William A. P. Smith
    [pdf][page]

  • Synthesizing Coupled 3D Face Modalities by Trunk-Branch Generative Adversarial Networks
    Baris Gecer, Alexander Lattas, Stylianos Ploumpis, Jiankang Deng, Athanasios Papaioannou, Stylianos Moschoglou, Stefanos Zafeiriou
    [arxiv][code]

2018

  • Generating 3D faces using Convolutional Mesh Autoencoders
    Anurag Ranjan, Timo Bolkart, Soubhik Sanyal, Michael J. Black
    [arxiv][page][code]

SIGGRAPH/TOG

2022

  • Deep Deformable 3D Caricatures with Learned Shape Control
    Yucheol Jung, Wonjong Jang, Soongjin Kim, Jiaolong Yang, Xin Tong, Seungyong Lee
    [arxiv][page][code]

2021

  • High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies
    Linchao Bao, Xiangkai Lin, Yajing Chen, Haoxian Zhang, Sheng Wang, Xuefei Zhe, Di Kang, Haozhi Huang, Xinwei Jiang, Jue Wang, Dong Yu, Zhengyou Zhang
    [arxiv][page][code]

  • Learning an Animatable Detailed 3D Face Model from In-The-Wild Images
    Yao Feng, Haiwen Feng, Michael J. Black, Timo Bolkart
    [arxiv][page][code]

2020

  • 3D Morphable Face Models -- Past, Present and Future
    Bernhard Egger, William A. P. Smith, Ayush Tewari, Stefanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernard, Timo Bolkart, Adam Kortylewski, Sami Romdhani, Christian Theobalt, Volker Blanz, Thomas Vetter
    [arxiv][page]

2017

  • Learning a model of facial shape and expression from 4D scans
    Tianye Li, Timo Bolkart, Michael J. Black, Hao Li, Javier Romero
    [pdf][page][code]

-2015

  • A morphable model for the synthesis of 3D faces
    Volker Blanz, Thomas Vetter
    [pdf]

  • Face transfer with multilinear models
    Daniel Vlasic, Matthew Brand, Hanspeter Pfister, Jovan Popovic
    [pdf]

ICLR

2021

  • Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANs
    Xingang Pan, Bo Dai, Ziwei Liu, Chen Change Loy, Ping Luo
    [arxiv][page][code]

IJCV

2020

  • Statistical Modeling of Craniofacial Shape and Texture
    Hang Dai, Nick Pears, William Smith, Christian Duncan
    [pdf][page]

2017

  • Large Scale 3D Morphable Modelss
    James Booth, Anastasios Roussos, Allan Ponniah, David Dunaway, Stefanos Zafeiriou
    [pdf][code]

TPAMI

2022

  • Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shape
    Xiangyu Zhu, Chang Yu, Di Huang, Zhen Lei, Hao Wang, Stan Z. Li
    [arxiv]

2021

  • AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANs
    Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris Gecer, Abhijeet Ghosh, Stefanos Zafeiriou
    [arxiv][page]

  • Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstruction
    Baris Gecer, Stylianos Ploumpis, Irene Kotsia, Stefanos Zafeiriou
    [arxiv][code]

2020

  • Towards a complete 3D morphable model of the human head
    Stylianos Ploumpis, Evangelos Ververas, Eimear O' Sullivan, Stylianos Moschoglou, Haoyang Wang, Nick Pears, William A. P. Smith, Baris Gecer, Stefanos Zafeiriou
    [arxiv][page]

2019

  • On Learning 3D Face Morphable Model from In-the-wild Images
    Luan Tran, Xiaoming Liu
    [arxiv][page][code]

2018

  • High-Fidelity Monocular Face Reconstruction Based on an Unsupervised Model-Based Face Autoencoder
    Ayush Tewari, Michael Zollhöfer, Florian Bernard, Pablo Garrido, Hyeongwoo Kim, Patrick Pérez, Christian Theobalt
    [pdf]

TIP

2021

  • SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction
    Zeyu Ruan, Changqing Zou, Longhai Wu, Gangshan Wu, Limin Wang
    [arxiv][code]

2020

  • Self-supervised Learning of Detailed 3D Face Reconstruction
    Yajing Chen, Fanzi Wu, Zeyu Wang, Yibing Song, Yonggen Ling, Linchao Bao
    [arxiv][code]