/ParaHome

Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactions

Primary LanguagePython

🏡 ParaHome

ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactions (arXiv 2024)
Jeonghwan Kim*, Jisoo Kim*, Jeonghyeon Na, Hanbyul Joo
[Project Page] [Paper] [Supp. Video]

Image

This is a repository of the ParaHome system. Our system is designed to capture human-object interaction in a natural home environment. We parameterized all 3D movements of body, hands, and objects and captured large-scale dataset for human-object interaction.

News

  • 🎊 Parahome demo data is available!

Download Demo files

mkdir data

Download demo files
scan : https://drive.google.com/file/d/1-OuWvVFOFCEhut7J2t1kNbr5jv78QNFP/view?usp=sharing
seq : https://drive.google.com/file/d/185dpSFm6afvG0wpgWLZrPsAOxuzMdbfb/view?usp=sharing

unzip and move scan, seq directories into data directory

.
├── assets
├── visualize
├── data
│   ├── scan
└── └── seq

Environment Setting

Check out install.md

Visualize Demo files

To visualize the demo parahome data, select sequence path in the data/seq directory and execute the command

cd visualize
python render.py --scene_root data/seq/s01

Citation

@misc{kim2024parahome,
      title={ParaHome: Parameterizing Everyday Home Activities Towards 3D Generative Modeling of Human-Object Interactions}, 
      author={Jeonghwan Kim and Jisoo Kim and Jeonghyeon Na and Hanbyul Joo},
      year={2024},
      eprint={2401.10232},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Acknowledgement

This work was supported by Samsung Electronics MX Division, NRF grant funded by the Korean government (MSIT) (No. 2022R1A2C2092724 and No. RS-2023-00218601), and IITP grant funded by the Korean government (MSIT) (No.2021-0-01343). H. Joo is the corresponding author.