/Deep-Virtual-Rapport-Agent

Deep virtual rapport agent & Head gesture detector

Primary LanguageJupyter Notebook

Deep Virtual Rapport Agent

Project: Deep Virtual Rapport Agent
Jan Ondras (jo951030@gmail.com)
Institute for Creative Technologies, University of Southern California
April-October 2019

Overview of the files in this folder:

./data_analysis
	Scripts to analyze and calculate statistics of datasets (vra1, sewa, nvb, hatice2010, ccdb, mimicry).

./datasets_scripts
	Scripts to preprocess datasets (vra1, sewa, nvb, hatice2010, 4comb, ccdb, mimicry).

./head_gesture_detector
	The Head Gesture Detector code. 
	Includes training, evaluation, model checkpoints, and prediction.

./notes
	Notes related to the Deep Virtual Rapport Agent project.
	Includes: notes on related work, datasets, models, OpenFace, SmartBody, and BML; results from head gesture detection; and my cheatsheet. 

./rapport_model
	The Rapport Model code. 
	Includes training, evaluation, model checkpoints, and prediction.

./reading
	Reading materials related to the Deep Virtual Rapport Agent project.

./smartbody_scripts
	Trial scripts used to test the communication with the Smartbody.