🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🍊 Jupyter Notebook

Notebook Info
Open In Colab VideoCrafter_Text2Video_colab
Open In Colab VideoCrafter_Image2Video_colab (Pro Colab High-RAM 😐)
Open In Colab VideoCrafter2_Text2Video_colab (Pro Colab High-RAM 😐)
open_in_kaggle_small VideoCrafter2_kaggle (Free Kaggle)

Tutorial

Screenshot 2023-10-13 161902

Main Repo

https://github.com/AILab-CVC/VideoCrafter

Paper

https://arxiv.org/abs/2401.09047 (VideoCrafter2)
https://arxiv.org/abs/2310.19512 (VideoCrafter1)
https://arxiv.org/abs/2211.13221 (Base Model)

Page

https://ailab-cvc.github.io/videocrafter2
https://yingqinghe.github.io/LVDM/ (Base Model)

Model

https://huggingface.co/VideoCrafter/Image2Video-512-v1.0/tree/main
https://huggingface.co/VideoCrafter/Text2Video-1024-v1.0/tree/main

Output

(VideoCrafter2) prompt: an elephant is walking under the sea, 4K, high definition

an_elephant_is_walking_under_t.mp4

(VideoCrafter1) prompt: A tiger walks in the forest, photorealistic, 4k, high definition

0001.mp4