/ComfyUI-InstantMesh

ComfyUI InstantMesh is custom nodes that running InstantMesh into ComfyUI

Primary LanguagePythonApache License 2.0Apache-2.0

(This repo is archived due to ComfyUI-3D-Pack supports InstantMesh, please check 3D-Pack directly if you need it)

ComfyUI InstantMesh

ComfyUI InstantMesh is custom nodes that running TencentARC/InstantMesh into ComfyUI

overall

Installation

Make sure you also install Visual Studio Build Tools. overall This extension depends on ComfyUI-3D-Pack, please install it if not, and make sure it works well:

  1. stop ComfyUI if it is running
  2. goto ComfyUI/custom_nodes dir in terminal(cmd)
  3. git clone https://github.com/MrForExample/ComfyUI-3D-Pack
  4. cd ComfyUI-3D-Pack
  5. run install_windows_portable_win_py311_cu121.bat

(Don't start ComfyUI at this moment)
Then, install this extension:

  1. git clone https://github.com/jtydhr88/ComfyUI-InstantMesh
  2. cd ComfyUI-InstantMesh
  3. run install_windows_portable_win_py311_cu121.bat

Start your ComfyUI.

How to use

Currently, this extension implements two custom nodes, InstantMeshLoader and InstantMeshRun

Regarding InstantMeshLoader, there are four configurations for checkpoints, please refer to TencentARC/InstantMesh for more details.

A simple workflow looks like: simple-connection And you can find it at simple-workflow
After generated, you could find results, mesh or texture, under ComfyUI/custom_nodes/ComfyUI-InstantMesh/output folder.

Another workflow I provided - example-workflow, generate 3D mesh from ComfyUI generated image, it requires:

  1. Main checkpoint - ReV Animated
  2. Lora - Clay Render Style

It will generate gypsum style 3D model: example-workflow1

Credit

  • TencentARC/InstantMesh - Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models
  • ComfyUI - A powerful and modular stable diffusion GUI.
  • ComfyUI-3D-Pack - An extensive node suite that enables ComfyUI to process 3D inputs (Mesh & UV Texture, etc) using cutting edge algorithms (3DGS, NeRF, etc.)

My extensions for ComfyUI

My extensions for stable diffusion webui

  • 3D Model/pose loader A custom extension for AUTOMATIC1111/stable-diffusion-webui that allows you to load your local 3D model/animation inside webui, or edit pose as well, then send screenshot to txt2img or img2img as your ControlNet's reference image.
  • Canvas Editor A custom extension for AUTOMATIC1111/stable-diffusion-webui that integrated a full capability canvas editor which you can use layer, text, image, elements and so on, then send to ControlNet, basing on Polotno.
  • StableStudio Adapter A custom extension for AUTOMATIC1111/stable-diffusion-webui to extend rest APIs to do some local operations, using in StableStudio.
  • Txt/Img to 3D Model A custom extension for sd-webui that allow you to generate 3D model from txt or image, basing on OpenAI Shap-E.
  • 3D Editor A custom extension for sd-webui that with 3D modeling features (add/edit basic elements, load your custom model, modify scene and so on), then send screenshot to txt2img or img2img as your ControlNet's reference image, basing on ThreeJS editor.