This repository is an Unreal Plugin demonstrating realtime AR Facial Pose Estimation.
This is one of three repositories which together form a larger project, these are the three repositories:
- facial-pose-estimation-pytorch-v2
- facial-pose-estimation-libtorch-dll
- facial-pose-estimation-unreal - You are here.
This blog post describes the whole project: AR Facial Pose Estimation
- This runs live on a desktop
- Tracks both the transform of the entire head, and the pose of the face
- Tracks a single face at a time, if two people stand in front of the camera the face will jump back and forth
- There are controls built in for manually adjusting camera FOV
- The
Neural Netused by the project can be found here: facial-pose-estimation-pytorch-v2
Usage instructions found here: user manual page.