Local version of Deforum Stable Diffusion V0.4, supports txt settings file input and animation features!
-
Stable Diffusion by Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, Björn Ommer and the Stability.ai Team.
-
Notebook by deforum
-
Special Thanks to VIVY Has A Dream for all the help!
👇Animated Video👇
Made this quick local Windows version mostly based on the Colab code by deforum, which supports very cool turbo mode animation output for Stable Diffusion!
As an artist and Unity game designer, I may not very familiar with Python code, so let me know whether there is any improvement for this project!
It's tested working on Windows 10 with RTX 2080 SUPER and RTX 3090 GPU (it runs somehow much faster on my local 3090 then Colab..), I haven't tested it on Mac though.
You can use an anaconda environment to host this local project:
conda create --name dsd python=3.8.5 -y
conda activate dsd
And then cd to the cloned folder, run the setup code, and wait for ≈ 5min until it's finished
python setup.py
You need to get the sd-v1-4.ckpt file and put it on the ./models folder first to use this. It can be downloaded from HuggingFace.
Additionally, you should put dpt_large-midas-2f21e586.pt on the ./models folder as well, the download link is here
There should be another extra file AdaBins_nyu.pt which should be downloaded into ./pretrained folder, the download link is here
The running command should looks like this:
python run.py --enable_animation_mode --settings "./runSettings_Template.txt"
After installation you can try out following examples to see if the code is working
-
- For generate still images:
python run.py --settings "./examples/runSettings_StillImages.txt"
-
- For animation feature, you need to add
--enable_animation_modeto enable animation settings in text file:
- For animation feature, you need to add
python run.py --enable_animation_mode --settings "./examples/runSettings_Animation.txt"
-
- For mask feature:
python run.py --settings "./examples/runSettings_Mask.txt"
Original Painting on Artstation
The output results will be available at ./output folder.
All the needed variables & prompts for Deforum Stable Diffusion are set in the txt file (You can refer to the Colab page for definition of all the variables), you can have many of settings files for different tasks. There is a template file called runSettings_Template.txt. You can create your own txt settings file as well.
That's it!