X-LANCE/AniTalker

Please Create a Gradio Webui

oisilener1982 opened this issue ยท 11 comments

I hope someone would create Gradio for Anitalker and is there a way to have stitching for the head to be connected back to the body after cropping just like in sadtalker?

This project has a potential to replace Sadtalker if head stitching would be implemented

@oisilener1982
Please could you share some samples you created using EchoM or SadTalker.

Here is an old example of Sadtalker
https://youtube.com/shorts/qJR0m4jGeGw?feature=share

Here is an example of MJ + Kling
https://youtu.be/_gEIUrV71RA

Echomimic + Sadtalker or Anitalker will be used if i upload in my main channel. I set the FPS in echomimic to 30 instead of 24

Echomimic.mp4

Hallo

Hallo.mp4

V-Express

Vexpress.mp4

I will upload Anitalker once Gradio Webui is available or please try this source file to compare the result with Anitalker
1111111111111111111

Nice. What is MJ + Kling?

mIdjourney + klingai

This project has a potential to replace Sadtalker if head stitching would be implemented

Hello, thank you for your suggestion. Stitching is a very important feature, and recently LivePortrait has also implemented a similar function. Since our crop box is fixed, you can try directly pasting it back. We haven't tested this, and if there are visible seams, it might require training a stitching model. This is not our highest priority at the moment, but if any users have tested it, we welcome feedback on their subsequent test results.

Liveportrait has stitching and gradio but it does not have audio driven
Anitalker has audio driven but does not have stitching and gradio
Echomimic has audio driven, gradio, emotion and quality but no stitching
Sadtalker has audio driven, stitching and gradio. It also has the best skin texture but lacks the emotion

@oisilener1982

Very good comparison, TQVM

Someone created a gradio but for google collab. Any update about the gradio for local install?

https://www.youtube.com/watch?v=RxOUCn1zbhM&t=57s

Here is my result for Anitalker using the google collab above

ANITALKER.mp4