ComfyUI Deploy

Open source comfyui deployment platform, a vercel for generative workflow infra. (serverless hosted gpu with vertical intergation with comfyui)

Join Discord to chat more or visit Comfy Deploy to get started!

# How it works

Comfy Deploy Dashboard (https://comfydeploy.com) or self-hosted version
Machines (Long running, on-premise ComfyUI machines and serverless)
Supports runpods, modal, and hosted ComfyDeploy machines (powered by modal)

comfydeploy1.mp4

Setting up a basic sd txt2img API

comfydeploy_base-sd-setup.mp4

Comfy Deploy Plugin Installation

Plugin lets you set up the machine as a target machine, and also upload workflow directly from there

cd custom_nodes
git clone https://github.com/BennyKok/comfyui-deploy.git
Go to (https://comfydeploy.com) or a self-hosted version
- Machines -> Add Machines
  - Enter a name and the URL of your machines (set up Ngrok for a public URL for your machines)
  - Create a new ComfyDeploy machines (pick any custom nodes).

Usecase

Deploy a complicated comfy workflow with a versioning system
Manage versioning and easily preview different generated versions' output
Persistent API generated for Production and Staging environment
Run the same comfyui workflow across different remote machines

# Status & Timeline

WIP, welcomes contributors!! Please join Discord -> https://discord.gg/EEYcQmdYZw

Primary goal -> release v0.1.0 of stable Comfy Deploy

Major areas

Security enforcement
Error handling
QOL workflow improvement
API usage examples
Load balancing
Workflow dependencies checking (custom nodes)
Remote machines
Serverless machines? Possible to set up a clean environment via Salad, Modal, etc
LCM realtime web socket image gen

Tech Stack

Shadcn UI
NextJS
Clerk (Auth)
Neon / Vercel Postgres (Database)
Drizzle (ORM)
R2 / S3 (Object Storage)

Development

git clone https://github.com/BennyKok/comfyui-deploy
cd web
bun i
Start docker
cp .env.example .env.local
Repace JWT_SECRET with openssl rand -hex 32
Get a local clerk dev key for NEXT_PUBLIC_CLERK_PUBLISHABLE_KEY and CLERK_SECRET_KEY
Keep a terminal live for bun run db-dev
Finally start the next server with bun dev

Schema Changes

bun run generate
bun run migrate-local

Special Thanks

comfyui
oss/acc

Self Hosting with Vercel

Build command

next build && bun run migrate-production

Install command

npx bun@1.0.16 install

Env key setup

POSTGRES_URL=

NEXT_PUBLIC_CLERK_PUBLISHABLE_KEY=
CLERK_SECRET_KEY=

SPACES_ENDPOINT="http://localhost:4566"
SPACES_ENDPOINT_CDN="http://localhost:4566"
SPACES_BUCKET="comfyui-deploy"
SPACES_KEY="xyz"
SPACES_SECRET="aaa"

# generate using -> openssl rand -hex 32
JWT_SECRET=

# r2 settings
SPACES_REGION="auto"
SPACES_CDN_FORCE_PATH_STYLE="true"
SPACES_CDN_DONT_INCLUDE_BUCKET="true"

# digital ocean settings
SPACES_REGION="nyc3"
SPACES_CDN_FORCE_PATH_STYLE="false"

# s3 settings
SPACES_REGION="nyc3"
SPACES_CDN_DONT_INCLUDE_BUCKET="false"
SPACES_CDN_FORCE_PATH_STYLE="true"

treksis/comfyui-deploy