/AVeryComfyNerd

ComfyUI related stuff and things

MIT LicenseMIT

Resources

A variety of ComfyUI related stuff. You'll need different models and custom nodes for each different workflow.

  • By default, models are saved in subdirectories under ComfyUI/models, though some custom nodes have their own models directory.
  • Use ComfyUI Manager to install missing custom nodes.
  • Be sure to keep ComfyUI updated regularly - including all custom nodes.
  • The Microsoft Windows portable version of ComfyUI apparently has issues, whereas normal installs are OK. Unknown error? Try a normal install!
  • Sometimes custom nodes make breaking changes and the same node may need to be re-created. Typically the custom node GitHub page has such information.
  • Need more help? See this Playlist with loads of ComfyUI guides
Item Description Link
ComfyUI The main thing you'll need! https://github.com/comfyanonymous/ComfyUI
See https://youtu.be/2r3uM_b3zA8 for an install guide
ComfyUI Manager Install any missing nodes using this https://github.com/ltdrdata/ComfyUI-Manager
Stability AI Models & VAEs https://huggingface.co/stabilityai
Text-to-Image models Text-2-image models https://huggingface.co/models?pipeline_tag=text-to-image&sort=trending
ControlNet Models ControlNet Models https://huggingface.co/lllyasviel/sd_control_collection/tree/main
https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main
QR Code Monster Control Net ControlNet Model https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster
TIAdapter Control Models https://github.com/TencentARC/T2I-Adapter
Control LoRA Control Models https://huggingface.co/stabilityai/control-lora
AnimateDiff Original repo, many links and more info https://github.com/guoyww/AnimateDiff
IPAdapter Extension Custom Nodes for ComfyUI https://github.com/laksjdjf/IPAdapter-ComfyUI
IPAdapter models Models https://huggingface.co/h94/IP-Adapter
Upscale Wiki Many models & info https://upscale.wiki/wiki/Main_Page
Artist Style Studies SDXL Prompt output examples for inspiration https://sdxl.parrotzone.art/

Workflows available

In ComfyUI the image IS the workflow. Simply drag or load a workflow image into ComfyUI!

Workflow Description
Simple SDXL ControlNet workflow.
Introductory SDXL Canny & Depth ControlNet example.
See https://youtu.be/reqamcrPYiM for more information.
Basic QR Code Monster SD 1.5 ControlNet - make spiral art!
See also - https://youtu.be/D4oJz0w36ps
QR Code Monster SD 1.5 ControlNet - make animated spiral art!
See also: https://youtu.be/D4oJz0w36ps
Updated QR Code Monster SD 1.5 ControlNet with AnimateDiff and FreeU
Works best with the v1 QR Code Monster - https://huggingface.co/monster-labs/control_v1p_sd15_qrcode_monster
AnimateDiff with Montion LoRA example. Pan up, down, left right, etc. SD 1.5
Instant LoRA 1
Inspired by AloeVera (almost identical).
Really simple, no training, "LoRA" like functionality.
SD 1.5. IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
Video guide - https://youtu.be/HtmIC6fqsMQ
Instant LoRA 2
As above, but with ControlNet to guide the shape
Instant LoRA 3
As above, but with QR Code Monster ControlNet too :)
Instant LoRA 4
As above, but with basic upscaling
Instant LoRA 5
As above, but with more upscaling to 16k+
Instant LoRA 6
As above, but different upscaling to 16k+
Morphing AI videos of any length using AnimateDiff. SD 1.5. Includes IPAdapter & Upscaling. IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
Video guide - https://youtu.be/6A3a0QNPhIs
Morphing AI videos of any length using AnimateDiff. SD 1.5. Includes Upscaling. Like above, but without IPAdapter controls.
SDXL "Instant LoRA" - basic.
Really simple, no training, "LoRA" like functionality.
Uses SDXL IP Adapter - https://huggingface.co/h94/IP-Adapter
SDXL "Instant LoRA" - with CLIP Vision
Uses SDXL IP Adapter - https://huggingface.co/h94/IP-Adapter
Also use "Revisions" CLIP vision - https://huggingface.co/stabilityai/control-lora
SDXL "Instant LoRA" - with CLIP Vision & ControlNet
Uses SDXL IP Adapter - https://huggingface.co/h94/IP-Adapter
Also use "Revisions" CLIP vision - https://huggingface.co/stabilityai/control-lora
AnimateDiff + QRCode (Vid2Vid)
Use any high-contrast input video to create guided animations! Spirals away...
SD 1.5 Reposer - single face image to any pose. Get consistent faces!
No "roop" or similar face-swapping nodes required = easy install!
SD 1.5 ControlNet models:
https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main
IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus-face_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
IPAdapter Extension - https://github.com/laksjdjf/IPAdapter-ComfyUI
Video guide - https://youtu.be/SacK9tMVNUA
SD 1.5 Reposer Plus - single face image to any pose. Get consistent faces!
Now also includes a supporting image for addings things like outfits
No "roop" or similar face-swapping nodes required = easy install!
SD 1.5 ControlNet models:
https://huggingface.co/comfyanonymous/ControlNet-v1-1_fp16_safetensors/tree/main
IP Adapter models:
1. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus-face_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
2. https://huggingface.co/h94/IP-Adapter/blob/main/models/image_encoder/model.safetensors -> "models/clip_vision".
3. https://huggingface.co/h94/IP-Adapter/blob/main/models/ip-adapter-plus_sd15.bin -> "custom_nodes/IPAdapter-ComfyUI/models".
IPAdapter Extension - https://github.com/laksjdjf/IPAdapter-ComfyUI
Video guide - https://youtu.be/ZcCfwTkYSz8
As above, but with a full bypass option for segment anything
As above, but with a full bypass option for segment anything and options for black, white or noisy backgrounds.

Custom Node List

The current custom node list is shown in the image below. This is a complete list. Not all nodes are used in workflows.