/Text-To-Video-Finetuning-colab

Primary LanguageJupyter NotebookThe UnlicenseUnlicense

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

Colab Info
Open In Colab dataset
Open In Colab train
Open In Colab train single video
Open In Colab inference

Data

https://github.com/microsoft/XPretrain/tree/main/hd-vila-100m (HD-VILA-100M Dataset)
http://toflow.csail.mit.edu/ (Vimeo-90k Dataset)
https://github.com/m-bain/webvid
Movie Trailers

Tag

https://github.com/Breakthrough/PySceneDetect
https://github.com/ExponentialML/Video-BLIP2-Preprocessor

Main Repo

https://github.com/ExponentialML/Text-To-Video-Finetuning

🚦 Prototype 🚦

Potat 1️⃣

Model: https://huggingface.co/camenduru/potat1
Dataset: https://huggingface.co/camenduru/potat1_dataset/tree/main

Potat 1️⃣ Output

Fruits.Strawberries.Flying.Falling.In.Air.Tabletop.Shot.High.Speed.Slow.Motion.5cf78a08.mp4

Please try it 🐣

https://github.com/camenduru/text-to-video-synthesis-colab