/awesome-human-human-interaction

A curated list of awesome human-human interaction resources.

awesome-human-human-interaction

A curated list of awesome human-human interaction (HHI) resources. If you find any errors or problems, please don't hesitate to comment.

Table of Contents

Datasets

Dataset Year Motions Frames Texts Scheme Modality
UMPM 2011 36 400K No MoCap Skeleton
SBU Kinect 2012 300 7.5K No RGB+D Skeleton
You2Me 2020 42 77K No RGB+D Skeleton
NTU RGB+D 120 2019 8,276 462K No RGB+D Skeleton
Chi3D 2020 373 63K No MoCap SMPL-X
ExPI 2022 115 30K No Multi RGB Skeleton
GTA Combat 2023 6.8K 2.05M No Synthetic Skeleton
Hi4D 2023 100 11K No Multi RGB SMPL
InterHuman 2023 6,022 1.7M Yes Multi RGB SMPL
Inter-X 2024 11,388 8.1M Yes MoCap SMPL-X, Skeleton

Recent Papers

HHI Generation

  • Inter-X: Towards Versatile Human-Human Interaction Analysis, CVPR'24 [Paper], [Project], [Code&Data]

  • ContactGen: Contact-Guided Interactive 3D Human Generation for Partners, AAAI'24 [Paper], [Project], [Code]

  • InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactions, IJCV'24 [Paper], [Project], [Code&Data]

  • ActFormer: A GAN-based Transformer towards General Action-Conditioned 3D Human Motion Generation, ICCV'23 [Paper], [Project], [Code]

  • PriorMDM: Human Motion Diffusion as a Generative Prior, ICLR'24 [Paper], [Project], [Code]

  • Neural Animation Layering for Synthesizing Martial Arts Movements, SIGGRAPH 2021 [Paper]

  • Local Motion Phases for Learning Multi-Contact Character Movements, SIGGRAPH 2020 [Paper], [Code]

HHI Reconstruction

  • Pose Priors from Language Models, arXiV 2024.05 [Paper]

  • MultiPhys: Multi-Person Physics-aware 3D Motion Estimation, CVPR'24 [Paper], [Project], [Code]

  • Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption, CVPR'24 [Paper], [Code]

  • MultiPhys: Multi-Person Physics-aware 3D Motion Estimation, arXiv 2024.04 [Paper], [Project], [Code]

  • Reconstructing Close Human Interactions from Multiple Views, SIGGRAPH Asia'23 [Paper], [Code]

  • Hi4D: 4D Instance Segmentation of Close Human Interaction, CVPR'23 [Paper], [Project], [Code&Data]

  • Multi-Person Extreme Motion Prediction, CVPR'22 [Paper], [Project], [Code]

HHI Detection

  • SportsHHI: A Dataset for Human-Human Interaction Detection in Sports Videos, CVPR'24 [Paper], [Code]

  • Inter-X: Towards Versatile Human-Human Interaction Analysis, CVPR'24 [Paper], [Project], [Code&Data]

  • IGFormer: Interaction Graph Transformer for Skeleton-based Human Interaction Recognition, ECCV'22 [Paper]

  • Human-to-Human Interaction Detection, arXiv 2023.07 [Paper]

Reaction Generation

  • PhysReaction: Physically Plausible Real-Time Humanoid Reaction Synthesis via Forward Dynamics Guided 4D Imitation, arXiv 2024.04 [Paper], [Project]

  • Inter-X: Towards Versatile Human-Human Interaction Analysis, CVPR'24 [Paper], [Project], [Code&Data]

  • ReGenNet: Towards Human Action-Reaction Synthesis, CVPR'24 [Paper], [Project], [Code]

  • Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecasting, arXiv 2023.12 [Paper], [Project]

  • Role-aware Interaction Generation from Textual Description, ICCV'23 [Paper], [Code]

  • ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactions, arXiv 2023.11 [Paper], [Project]

  • Interaction transformer for human reaction generation, TMM'23 [Paper]