CMU-Perceptual-Computing-Lab/socialSignalPred

Towards Social Artificial Intelligence: Nonverbal Social Signal Prediction in A Triadic Interaction

Hanbyul Joo, Tomas Simon, Mina Cikara, Yaser Sheikh CVPR 2019

(This code is still under construction. Will update asap)

Dataset Download

• Clone the panoptic toolbox: Panoptic Toolbox
• In your panoptic toolbox root, Run the following script to download haggling sequences:

scripts/getDB_haggling.sh

Dataset Preprocessing

See Preprocessing Haggling Data

Predicting Speaking

Training

Testing

Predicting Formation

Training

Testing

Predicting Gestures

Training

Testing

Reference

The code borrowed many parts (especially to pre-process motion capture data) from Daniel Holden's code for "A Deep Learning Framework For Character Motion Synthesis and Editing, SIGGRAPH 2016" paper.