/AVeryComfyNerd

ComfyUI related stuff and things

MIT LicenseMIT

Resources

A variety of ComfyUI related stuff. You'll need different models and custom nodes for each different workflow. By default, models are saved in subdirectories under ComfyUI/models, though some custom nodes have their own models directory. Use ComfyUI Manager to install missing custom nodes. Be sure to keep ComfyUI updated regularly.

Playlist with loads of ComfyUI guides

Item Description Link
ComfyUI The main thing you'll need! https://github.com/comfyanonymous/ComfyUI
See https://youtu.be/2r3uM_b3zA8 for an install guide
ComfyUI Manager Install any missing nodes using this https://github.com/ltdrdata/ComfyUI-Manager
Stability AI Models & VAEs https://huggingface.co/stabilityai
Text-to-Image models Text-2-image models https://huggingface.co/models?pipeline_tag=text-to-image&sort=trending
ControlNet Models ControlNet Models https://huggingface.co/lllyasviel/sd_control_collection/tree/main
https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main
QR Code Monster Control Net ControlNet Model https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster
TIAdapter Control Models https://github.com/TencentARC/T2I-Adapter
Control LoRA Control Models https://huggingface.co/stabilityai/control-lora
AnimateDiff Original repo, many links and more info https://github.com/guoyww/AnimateDiff
IPAdapter models Models https://huggingface.co/h94/IP-Adapter
Upscale Wiki Many models & info https://upscale.wiki/wiki/Main_Page
Artist Style Studies SDXL Prompt output examples for inspiration https://sdxl.parrotzone.art/

Workflows available

In ComfyUI the image IS the workflow. Simply drag or load a workflow image into ComfyUI!

Workflow Description
Simple SDXL ControlNet workflow.
Introductory SDXL Canny & Depth ControlNet example.
See https://youtu.be/reqamcrPYiM for more information.
nr_sd15_QR_Monster.json Basic QR Code Monster SD 1.5 ControlNet - make spiral art!
See also - https://youtu.be/D4oJz0w36ps
nr_sd15_QR_Monster_AnimateDiff_LatentUpscale QR Code Monster SD 1.5 ControlNet - make animated spiral art!
See also: https://youtu.be/D4oJz0w36ps
Updated QR Code Monster SD 1.5 ControlNet with AnimateDiff and FreeU
Works best with the v1 QR Code Monster - https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster
AnimateDiff with Montion LoRA example. Pan up, down, left right, etc. SD 1.5
Instant LoRA 1
Inspired by AloeVera (almost identical).
Really simple, no training, "LoRA" like functionality.
SD 1.5. IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
Video guide - https://youtu.be/HtmIC6fqsMQ
Instant LoRA 2
As above, but with ControlNet to guide the shape
Instant LoRA 3
As above, but with QR Code Monster ControlNet too :)
Instant LoRA 4
As above, but with basic upscaling
Instant LoRA 5
As above, but with more upscaling to 16k+
Instant LoRA 6
As above, but different upscaling to 16k+
Morphing AI videos of any length using AnimateDiff. SD 1.5. Includes IPAdapter & Upscaling. IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
Video guide - https://youtu.be/6A3a0QNPhIs
Morphing AI videos of any length using AnimateDiff. SD 1.5. Includes Upscaling. Like above, but without IPAdapter controls.
SDXL "Instant LoRA" - basic.
Really simple, no training, "LoRA" like functionality.
Uses SDXL IP Adapter - https://huggingface.co/h94/IP-Adapter
SDXL "Instant LoRA" - with CLIP Vision
Uses SDXL IP Adapter - https://huggingface.co/h94/IP-Adapter
Also use "Revisions" CLIP vision - https://huggingface.co/stabilityai/control-lora
SDXL "Instant LoRA" - with CLIP Vision & ControlNet
Uses SDXL IP Adapter - https://huggingface.co/h94/IP-Adapter
Also use "Revisions" CLIP vision - https://huggingface.co/stabilityai/control-lora
AnimateDiff + QRCode (Vid2Vid)
Use any high-contrast input video to create guided animations! Spirals away...
SD 1.5 Reposer - single face image to any pose. Get consistent faces!
No "roop" or similar face-swapping nodes required = easy install!
SD 1.5 ControlNet models:
https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main
IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus-face_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
Video guide - https://youtu.be/SacK9tMVNUA