ali-vilab/UniAnimate

Anime Faces do not look good

SWAPv1 opened this issue · 2 comments

Hello.

Your examples show Chibi Anime characters with very clear face but when I run the inference it turns into semi realistic face with very low detail. Sometimes it just makes my Anime character which has a big head change to a human person.

Is there a setting I need to use such as resolution and steps and CFG to achieve a better result?

Hi, there are some reasons for face inconsistency:

  1. The face of target pose is not aligned with the face of source image, probably because the anime face extracted by dwpose is not accurate.
  2. You could try using the first frame to generate the video, i.e. the ['image','local_image', "dwpose"] setting (
    ['image','local_image', "dwpose"], # reference image as the first frame of the generated video (optional)
    )

And we are considering open sourcing an upgraded version of the model in the near future, which has a better appearance retention. Thanks for your attention.

Thank you for quick feedback. It is exciting to hear you will source a upgraded version!!