LizhenWangT/FaceVerse

Poor lip tracking

Inferencer opened this issue · 1 comments

Hi I noticed you have been online all day helping people including myself across your projects so I just wanted to say it's much appreciated as I know most of them and it's been a big help.

I wanted to ask about the quality of tracking as the outputs are all such a low resolution (256x256) I figure that's the reason I am getting sub-optimal results with lip-synchronization and if you had any plans to increase the quality, I understand this would come at a cost to speed but without better tracking I don't see much utility in StyleAvatar

please find the files "Driving.mp4" as the Lip-synced video
and "Lip-sync.mp4" the result of StyleAvatar
https://drive.google.com/drive/folders/1d0yzTnaDM-O4hYV3aXuHJiTMwFZZ10B2?usp=sharing

It could be the case I could just change a few settings or switch to linux for better tracking but I am unsure if this is the case