philgras/neural-head-avatars

eye blink problem

Opened this issue · 1 comments

hi~ When "eye blink" in my training data, the corresponding geometry will have strong shaking. Why does this happen? I saw the video on YouTube and the NHA blinked without shaking and I wondered how it was done. Is it because I have a smaller sample of blinks?

“These artifacts occur due to the incomplete disentanglement of the expression / pose blendshapes of the underlying 3DMM. They are known limitations to that method.”

1、So mesh defomation when eye close are inevitable, aren't they?
Is there a solution to this problem?
2、Is there no eye close in 3DMM expression parameters(N x 100)? or eye close in 3DMM expression parameters is not study well?