kabachuha/sd-webui-text2video

[Feature Request]: Add ControlNet support for 2D frames

kabachuha opened this issue · 2 comments

kabachuha commented

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

ControlNet controlling the 2D frames slice, possibly controlling the 3D stuff later as well (But it's called InfiNet for that 😉).

So the things such as below will be possible in ModelScope as well

let-dance-64

Proposed workflow

  1. Add a ControlNet tab and do some stuff with the 2D frames using it

Additional information

So, it's basically implemented in VideoCrafter under the name of T2I adapter