This repository contains the HMDO (Hand Manipulation with Deformable Objects) dataset for the paper "HMDO: Markerless multi-view hand manipulation capture with deformable objects".
[Paper]
The HMDO dataset is the markerless deformable interaction dataset, which records the interactive motions of the hands and 12 deformable objects. Its main focus is the non-rigid contact deformation of interacting objects.
# object = 12
# cam = 10
# frame = 21600
The HMDO dataset layout is described as below.
${HMDO}
|-- sequence
| |-- img
| | |-- cam00 ~ cam09
| |-- hand_mesh
| | |-- hand_mesh.ply
| |-- object_mesh
| | |-- object_mesh.ply
| |-- hand_annotation
| | |-- hand_annotation.txt
| |-- object_annotation
| | |-- object_annotation.txt
| |-- calib.yml
|-- template_models
hand_annotation.txt contains information about hand parameters (scale, trans, mano_fullpose).
object_annotation.txt contains information about object 6DoF pose.
calib.yml contains information about cam_extrinsic and cam_intrinsic parameters for 10 cameras.
For questions about the dataset please contact Yangang Wang (yangangwang@seu.edu.cn) and Wei Xie (xiewei.xw@outlook.com).
This dataset is provided for research purposes only. Any commercial use is prohibited. If you use the dataset or parts of it in your research, please cite the following paper.
@article{xie2023hmdo,
title={HMDO: Markerless multi-view hand manipulation capture with deformable objects},
author={Xie, Wei and Yu, Zhipeng and Zhao, Zimeng and Zuo, Binghui and Wang, Yangang},
journal={Graphical Models},
volume={127},
pages={101178},
year={2023},
publisher={Elsevier}
}