/FacialAnimation_OpenFace

OpenFace is get from https://github.com/TadasBaltrusaitis/OpenFace, a state-of-the art open source tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation.

Primary LanguageC++

Facial animation based on OpenFace(an open source facial behavior analysis toolkit)

OpenFace is get from https://github.com/TadasBaltrusaitis/OpenFace, a state-of-the art open source tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. And I create a facial animation project on Windows, it can work in both real-time videos and off-line videos. Using the facial landmarks and head pose obtained from the openface tool. I created a mapping relation between the model and the facial landmarks so that the vertices of the model will deformed by the variation of landmarks.

OpenFace

The system is capable of performing a number of facial analysis tasks:

  • Facial Landmark Detection

Sample facial landmark detection image

  • Facial Landmark and head pose tracking (links to YouTube videos)

Multiple Face Tracking Multiple Face Tracking

  • Facial Feature Extraction (aligned faces and HOG features)

Sample aligned face and HOG image

Facial Animation

Facial animation Facial animation1 Facial animation2