zhou431496/Awesome-Avatars

List of recent advances for human avatars, including generation, reconstruction, and editing, etc.

Awesome Avatars

List of recent advances for human avatars, including generation, reconstruction, and editing, etc.

Table of Contents

• Awesome Avatars
  • Avatar Generation
  • Per-subject Avatar Reconstruction
  • Generalizable Avatar Novel View Synthesis
  • Generalizable Avatar Mesh Reconstruction
  • Text-to-Avatar
  • Avatar Interaction
  • Motion Generation
  • SMPL Estimation
  • Dataset
  • Aknowledgement

Avatar Generation

• Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representations (ECCV 2022)
  

• GENERATIVE NEURAL ARTICULATED RADIANCE FIELDS (NeurIPS 2022)
  

• AvatarGen: a 3D Generative Model for Animatable Human Avatars (arXiv 01/08/2022)
  

• EVA3D: Compositional 3D Human Generation from 2D Image Collections (ICLR 2023 Spotlight)
  

• AG3D: Learning to Generate 3D Avatars from 2D Image Collections (ICCV 2023)
  

• Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priors. (ICCV 2023)
  

Per-subject Avatar Reconstruction

• Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans (CVPR 2021)
  

• Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies (ICCV 2021)
  

• InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds (arXiv 20/12/2022)
  

• Neural Human Radiance Field from a Single Video (ECCV 2022)
  

• HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video (CVPR 2022)
  

• MonoHuman: Animatable Human Neural Field from Monocular Video (CVPR 2023)
  

• Vid2Avatar: 3D Avatar Reconstruction From Videos in the Wild via Self-Supervised Scene Decomposition (CVPR 2023)
  

• TeCH: Text-guided Reconstruction of Lifelike Clothed Humans (arXiv 19/08/2023)
  

• Relightable and Animatable Neural Avatar from Sparse-View Video (arXiv 17/08/2023)
  

Generalizable Avatar Novel View Synthesis

• Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering (NeurIPS 2021)
  

• MPS-NeRF: Generalizable 3D Human Rendering from Multiview Images (TPAMI 2022)
  

• GP-NeRF: Geometry-Guided Progressive NeRF for Generalizable and Efficient Neural Human Rendering (ECCV 2022)
  

• HumanNeRF: Efficiently Generated Human Radiance Field from Sparse Inputs (CVPR 2022)
  

• MonoNHR: Monocular Neural Human Renderer (3DV 2022)
  

• Neural Novel Actor: Learning a Generalized Animatable Neural Representation for Human Actors (TVCG 2023)
  

• GHuNeRF: Generalizable Human NeRF from a Monocular Video (arXiv 03/09/2023)
  

• ActorsNeRF: Animatable Few-shot Human Rendering with Generalizable NeRFs (ICCV 2023)
  

• SHERF: Generalizable Human NeRF from a Single Image (ICCV 2023)
  

• TransHuman: A Transformer-based Human Representation for Generalizable Neural Human Rendering (ICCV 2023)
  

Generalizable Avatar Mesh Reconstruction

• Global-correlated 3D-decoupling Transformer for Clothed Avatar Reconstruction (NeurIPS 2023)
  

• ICON : Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans (CVPR 2022)
  

• ECON: Explicit Clothed humans Optimized via Normal integration (CVPR 2023 Highlight)
  

• Structured 3D Features for Reconstructing Relightable and Animatable Avatars (CVPR2023)
  

• SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction (CVPR2023)
  

• DIFu: Depth-Guided Implicit Function for Clothed Human Reconstruction (CVPR2023)
  

• Complete 3D Human Reconstruction from a Single Incomplete Image (CVPR2023)
  

• High-fidelity 3D Human Digitization from Single 2K Resolution Images (CVPR2023 Highlight)
  

• D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field (ICCV2023)
  

Text-to-Avatar

• ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image. (arXiv 25/5/2023)
  

• DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models (arXiv 06/04/2023)
  

• DreamHuman: Animatable 3D Avatars from Text (arXiv 15/06/2023)
  

• AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose (arXiv 07/08/2023)
  

• Dancing Avatar: Pose and Text-Guided Human Motion Videos Synthesis with Image Diffusion Model (arXiv 15/08/2023)
  

• DreamWaltz: Make a Scene with Complex 3D Animatable Avatars (arXiv 12/07/2023)
  

• AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Control (ICCV 2023)
  

• AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars (SIGGRAPH 2022)
  

• AvatarBooth: High-Quality and Customizable 3D Human Avatar Generation (arXiv 16/06/2023)
  

• AvatarFusion: Zero-shot Generation of Clothing-Decoupled 3D Avatars Using 2D Diffusion (ACMMM 2023)
  

• TADA! Text to Animatable Digital Avatars (arXiv 2023)
  

• Guide3D: Create 3D Avatars from Text and Image Guidance (arXiv 2023)
  

Avatar Interaction

• Hi4D: 4D Instance Segmentation of Close Human Interaction (CVPR 2023)
  

• NeuralDome: A Neural Modeling Pipeline on Multi-View Human-Object Interactions. (CVPR 2023)
  

• HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video (CVPR 2023)
  

Motion Generation

• MotionGPT: Human Motion as a Foreign Language (arxiv)
  

• Executing your Commands via Motion Diffusion in Latent Space (CVPR 2023)
  

• TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis (ICCV 2023)
  

• Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation (ICCV 2023)
  

SMPL Estimation

• Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loop (ICCV 2019)
  
• Global-to-Local Modeling for Video-based 3D Human Pose and Shape Estimation (CVPR 2023)
  
• JOTR: 3D Joint Contrastive Learning with Transformers for Occluded Human Mesh Recovery (ICCV 2023)
  
• TRACE: 5D Temporal Regression of Avatars with Dynamic Cameras in 3D Environments (CVPR 2023)
  
• GLAMR: Global occlusion-aware human mesh recovery with dynamic cameras (CVPR 2022 Oral)
  
• D&d: Learning human dynamics from dynamic camera (ECCV 2022 Oral)
  
• CLIFF: Carrying location information in full frames into human pose and shape estimation (ECCV 2022 Oral)
  
• End-to-end human pose and mesh reconstruction with transformers. (CVPR 2021)
  
• Hybrik: A hybrid analytical-neural inverse kinematics solution for 3d human pose and shape estimation (CVPR 2021)
  

Dataset

• CLOTH4D: A Dataset for Clothed Human Reconstruction (CVPR 2023)
  

• High-fidelity 3D Human Digitization from Single 2K Resolution Images (2K2K) (CVPR 2023)
  

• Function4D: Real-time Human Volumetric Capture from Very Sparse RGBD Sensors (Thuman-2.0 Dataset) (CVPR 2021 Oral)
  

• HuMMan: Multi-Modal 4D Human Dataset for Versatile Sensing and Modeling (ECCV 2022 Oral)
  

Aknowledgement

• We thank the template from Awesome-Video-Diffusion.

• The main contributors of this project are from ReLER Lab, CCAI, Zhejiang University.