Awesome Neural Fields for 3D Reconstruction

Awesome Maintenance PR's Welcome License: MIT

A curated list of Neural Fields or Implicit Representations papers for 3D Reconstruction, inspired by awesome-neural-rendering.

Any contributions are much appreciated, please feel free to pull a request and offer the paper information as following format:

**Title of Paper.**<br>
*Author 1, Author 2, and Author 3.*<br>
Conference or Journal Year. [[PDF](link)] [[Project](link)] [[Github](link)] [[Video](link)] [[Data](link)]

Table of Contents

Papers

BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis.
Anonymous Authors.
arXiv 2023. [PDF] [Project]

Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement.
Jiaxiang Tang, Hang Zhou, Xiaokang Chen, Tianshu Hu, Errui Ding, Jingdong Wang, Gang Zeng.
arXiv 2023. [PDF] [Project]

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion.
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo.
arXiv 2022. [PDF] [Project]

Reconstructing Hand-Held Objects from Monocular Video.
Di Huang, Xiaopeng Ji, Xingyi He, Jiaming Sun, Tong He, Qing Shuai, Wanli Ouyang, Xiaowei Zhou.
SIGGRAPH Asia 2022. [PDF] [Project] [Github]

HF-NeuS: Improved Surface Reconstruction Using High-Frequency Details.
Yiqun Wang, Ivan Skorokhodov, Peter Wonka.
NeurIPS 2022. [PDF] [Github]

SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse views.
Xiaoxiao Long, Cheng Lin, Peng Wang, Taku Komura, Wenping Wang.
ECCV 2022. [PDF] [Project] [Github]

NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors.
Jiepeng Wang, Peng Wang, Xiaoxiao Long, Christian Theobalt, Taku Komura, Lingjie Liu, Wenping Wang.
arXiv preprint 2022. [PDF] [Project]

GO-Surf: Neural Feature Grid Optimization for Fast, High-Fidelity RGB-D Surface Reconstruction.
Jingwen Wang, Tymoteusz Bleja, Lourdes Agapito.
3DV 2022. [PDF] [Project]

NICE-SLAM: Neural Implicit Scalable Encoding for SLAM.
Zihan Zhu, Songyou Peng, Viktor Larsson, Weiwei Xu, Hujun Bao, Zhaopeng Cui, Martin R. Oswald, Marc Pollefeys.
CVPR 2022. [PDF] [Project] [Github]

BNV-Fusion: Dense 3D Reconstruction using Bi-level Neural Volume Fusion.
Kejie Li, Yansong Tang, Victor Adrian Prisacariu, Philip H.S. Torr.
CVPR 2022. [PDF] [Github] [Video]

NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction.
Xiaoshuai Zhang, Sai Bi, Kalyan Sunkavalli, Hao Su, Zexiang Xu.
CVPR 2022. [PDF] [Project] [Github]

Urban Radiance Fields.
Konstantinos Rematas, Andrew Liu, Pratul P. Srinivasan, Jonathan T. Barron, Andrea Tagliasacchi, Thomas Funkhouser, Vittorio Ferrari.
CVPR 2022. [PDF] [Project]

Neural RGB-D Surface Reconstruction.
Dejan Azinović, Ricardo Martin-Brualla, Dan B Goldman, Matthias Nießner, Justus Thies.
CVPR 2022. [PDF] [Project] [Github]

Neural 3D Scene Reconstruction with the Manhattan-world Assumption.
Haoyu Guo, Sida Peng, Haotong Lin, Qianqian Wang, Guofeng Zhang, Hujun Bao, Xiaowei Zhou.
CVPR 2022. [PDF] [Project] [Github]

Neural 3D Reconstruction in the Wild.
Jiaming Sun, Xi Chen, Qianqian Wang, Zhengqi Li, Hadar Averbuch-Elor, Xiaowei Zhou, Noah Snavely.
SIGGRAPH 2022. [PDF] [Project] [Github]

iSDF: Real-Time Neural Signed Distance Fields for Robot Perception.
Joseph Ortiz, Alexander Clegg, Jing Dong, Edgar Sucar, David Novotny, Michael Zollhoefer, Mustafa Mukadam.
RSS 2022. [PDF] [Project] [Github]

Volume Rendering of Neural Implicit Surfaces.
Lior Yariv, Jiatao Gu, Yoni Kasten, Yaron Lipman.
NeurIPS 2021. [PDF] [Project] [Github]

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction.
Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang.
NeurIPS 2021. [PDF] [Project] [Github]

UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction.
Michael Oechsle, Songyou Peng, Andreas Geiger.
ICCV 2021. [PDF] [Project] [Github]

Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance.
Lior Yariv, Yoni Kasten, Dror Moran, Meirav Galun, Matan Atzmon, Ronen Basri, Yaron Lipman.
NeurIPS 2020. [PDF] [Project] [Github]

Occupancy Networks: Learning 3D Reconstruction in Function Space.
Lars Mescheder, Michael Oechsle, Michael Niemeyer, Sebastian Nowozin, Andreas Geiger.
CVPR 2019. [PDF] [Github]

DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation.
Jeong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, Steven Lovegrove.
CVPR 2019. [PDF] [Github]

Related Resources

Survey/Course

Neural Volumetric Rendering for Computer Vision.
ECCV 2022 Tutorial. [Project]

Advances in Neural Rendering.
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, Vladislav Golyanik.
EUROGRAPHICS 2022 State of the Art Report. [PDF]

Neural Fields in Visual Computing and Beyond.
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar.
EUROGRAPHICS 2022 State of the Art Report. [PDF] [Project]

Neural Fields in Computer Vision.
CVPR 2022 Tutorial. [Project]

Advances in Neural Rendering.
SIGGRAPH 2021 Course. [Project]

NeRF at CVPR 2022

Open Source Framework (for Nerf)

ArcNerf

sdfstudio

nerfstudio

JNeRF

xrnerf

neurecon

Other Awesome Lists

Awesome 3D Reconstruction

Awesome Neural Rendering

Awesome Neural Radiance Fields

awesome-implicit-representations

Awesome Implicit NeRF Robotics