/comfyui-workflows

comfyui workflows by roblaughter

ComfyUI Workflows

This repo contains common workflows for generating AI images with ComfyUI. To get started with AI image generation, check out my guide on Medium.

Files

  • SDXL Pipeline. A basic SDXL image generation pipeline with two stages (first pass and upscale/refiner pass) and optional optimizations. Use with any SDXL model, such as my RobMix Ultimate checkpoint.
  • Clarity Upscaler. A ComfyUI implementation of the Clarity Upscaler, a "free and open source Magnific alternative." Out of the box, upscales images 2x with some optimizations for added detail. See the documentation here.
  • IC-Light Basic. An implementation of IC-Light relighting model using the ComfyUI native implementation. This version replaces the background based on text prompt and relights the image to match.
  • IC-Light Background. Same as above, but accepts a background image, adds the foreground to the background, and relights the image to match.
  • CosXL Sample Workflow. A sample workflow for running CosXL models, such as my RobMix CosXL checkpoint. CosXL models have better dynamic range and finer control than SDXL models.
  • CosXL Edit Sample Workflow. A sample workflow for running CosXL Edit models, such as my RobMix CosXL Edit checkpoint. A CosXL Edit model takes a source image as input alongside a prompt, and interprets the prompt as an instruction for how to alter the image, similar to InstructPix2Pix.

Helpful Addons

Checkpoints

LoRAs

The LoRAs below are used in the Clarity Upscaler workflow for adding detail.

Upscale Models

  • NomosUniDAT_otf.pth. A 4x upscaler used in my Clarity Upscale workflow. Any upscale model can be used in its place.

IC-Light Models

  • Download from HuggingFace. For the IC-Light workflow.
  • Use fb version for basic workflow that generates a background from the prompt.
  • Use fbc version for blending an image with an existing background.

Custom Nodes

Some workflows (such as the Clarity Upscale workflow) include custom nodes that aren't included in base ComfyUI. Install these with Install Missing Custom Nodes in ComfyUI Manager.

  • ComfyUI Inspire Pack. Includes the Ksampler Inspire node that includes the Align Your Steps scheduler for improved image quality. Standard KSampler with your preferred scheduler can be used in its place.
  • ComfyUI NN Latent Upscale. A neural network latent upscale for much higher quality compared with an interpolated latent upscale. Standard latent upscaler can be used in its place with poorer results.
  • Perturbed Attention Guidance. An advanced implementation of the Perturbed Attention Guidance (PAG) node in ComfyUI. PAG is an alternative to CFG for creating higher quality images with better prompt adherence. Lower CFG proportionally, or use PAG's scaling. The standard PAG node can be used in its place.
  • ComfyUI Post Processing Nodes. Optional nodes for basic post processing, such as adjusting tone, contrast, and color balance, adding grain, vignette, etc. Helpful for taking the AI "edge" off of images as part of your workflow by reducing contrast, balancing brightness, and adding some subtle grain for texture.
  • ComfyUI-CADS. Injects noise early in the generation process to create more varied compositions. Totally optional.