Human-Object Interaction Detection: A Quick Survey and Examination of Methods

Our survey & examination paper[ArXiv]

@article{bergstrom20human,
  title={Human-Object Interaction Detection: A Quick Survey and Examination of Methods},
  author={Bergstrom, Trevor and Shi, Humphrey},
  journal={The 1st International Workshop on Human-Centric Multimedia Analysis at ACM Multimedia Conference},
  year={2020}
}

Datasets

Evaluation Metrics

To be updated soon.

Papers

Models:

  • HORCNN (Learning to Detect Human-Object Interactions) - Chao, Yu-Wei and Liu, Yunfan and Liu, Xieyang and Zeng, Huayi and Deng, Jia [paper]
  • InteractNet (Detecting and Recognizing Human-Object Interactions) - Gkioxari, Georgia and Girshick, Ross and Doll'ar, Piotr and He, Kaiming [paper]
  • iCAN (iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection) - Gao, Chen and Zou, Yuliang and Huang, Jia-Bin [paper]
  • GPNN (Learning Human-Object Interactions by Graph Parsing Neural Networks) - Qi, Siyuan and Wang, Wenguan and Jia, Baoxiong and Shen, Jianbing and Zhu, Song-Chun [paper]
  • Transferable Interactiveness Network (Transferable Interactiveness Prior for Human-Object Interaction Detection) - Li, Yong-Lu and Zhou, Siyuan and Huang, Xijie and Xu, Liang and Ma, Ze and Fang, Hao-Shu and Wang, Yan-Feng and Lu, Cewu [paper]
  • iHOI (Interact as you intend: Intention-driven human-object interaction detection) - Xu, Bingjie and Li, Junnan and Wong, Yongkang and Zhao, Qi and Kankanhalli, Mohan S [paper]
  • VS-GAT (Visual-Semantic Graph Attention Network for Human-Object Interaction Detection) - Liang, Zhijun and Guan, Yisheng and Rojas, Juan [paper]
  • VCL (Visual Compositional Learning for Human-Object Interaction Detection) - Hou, Zhi and Peng, Xiaojiang and Qiao, Yu and Tao, Dacheng [paper]
  • RPNN (Relation Parsing Neural Network for Human-Object Interaction Detection) - Zhou, Penghao and Chi, Mingmin [paper]
  • Cascaded HOI Detection (Cascaded Human-Object Interaction Recognition) - Zhou, Tianfei and Wang, Wenguan and Qi, Siyuan and Ling, Haibin and Shen, Jianbing [paper]
  • SIGN (Skeleton-Based Interactive Graph Network For Human Object Interaction Detection) - Zheng, Sipeng and Chen, Shizhe and Jin, Qin [paper]
  • PPDM (PPDM: Parallel Point Detection and Matching for Real-Time Human-Object Interaction Detection) - Liao, Yue and Liu, Si and Wang, Fei and Chen, Yanjie and Qian, Chen and Feng, Jiashi [paper]
  • PMN (Pose-based Modular Network for Human-Object Interaction Detection) - Liang, Zhijun and Liu, Junfa and Guan, Yisheng and Rojas, Juan [paper]
  • Compositional Learning (Compositional Learning for Human Object Interaction) - Kato, Keizo and Li, Yin and Gupta, Abhinav [paper]
  • (Learning to Detect Human-Object Interactions with Knowledge) - Xu, Bingjie and Wong, Yongkang and Li, Junnan and Zhao, Qi and Kankanhalli, Mohan S [paper]
  • (Modeling Mutual Context of Object and Human Pose in Human-Object Interaction Activities) - Yao, Bangpeng and Fei-Fei, Li [paper] To be updated soon.

Code

Code can be found here for now: https://github.com/trevorbergstrom/HOI-Toolkit

Will be added to this repo soon.