gelmin

SPEECH-DRIVEN-AUTOMATIC-GESTURE-GENERATION

My work extends prior work on deep learning for gesture generation by applying representation learning. The motion representation is learned first, after which a network is trained to predict such representations from speech, instead of directly mapping speech to raw joint coordinates as in prior work. We also evaluated the effect of different representations for the input speech. The experiments show that representation learning improves the objective and subjective performance of the speech-to-gesture neural network.

vdeoKompanyUi

gelmin/SPEECH-DRIVEN-AUTOMATIC-GESTURE-GENERATION

My work extends prior work on deep learning for gesture generation by applying representation learning. The motion representation is learned first, after which a network is trained to predict such representations from speech, instead of directly mapping speech to raw joint coordinates as in prior work. We also evaluated the effect of different representations for the input speech. The experiments show that representation learning improves the objective and subjective performance of the speech-to-gesture neural network.

gelmin/vdeoKompanyUi