/Comfyui_CXH_joy_caption

Recommended based on comfyui node pictures:Joy_caption + MiniCPMv2_6-prompt-generator + florence2

Primary LanguagePythonApache License 2.0Apache-2.0

.2024-9-2 更新批量打标案例(Update batch marking cases) 速度：florence2<min2.6<joy

1724901350282

(1).基于comfyui节点图片放推(Recommended based on comfyui node pictures)

1.Joy_caption

2.miniCPMv2_6_prompt_generator

3.florence2

(2).安装(Installation)：

1.（Comfyui evn python.exe） python -m pip install -r requirements.txt or click install_req.bat

注意：transformers 版本不能太低（Note: The version of transformers cannot be too low）

  1. 下载模型或者运行comfyui自动下载模型到合适文件夹(Download the model or run Comfyui to automatically download the model to the appropriate folder)

(3) 模型安装（Install model）

1).Joy_caption

.运行自动下载模型(推荐手动下载) Run automatic download model (manual download recommended)

1.https://huggingface.co/google/siglip-so400m-patch14-384 放到(put in)clip/siglip-so400m-patch14-384

1724901434148

2. https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit 放到(put in)LLM/Meta-Llama-3.1-8B-bnb-4bit

1724901495135

3.必须手动下载(Must be downloaded manually):https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main/wpkklhc6   (put in)Joy_caption

1724901527482

2).MiniCPMv2_6-prompt-generator + CogFlorence

https://huggingface.co/pzc163/MiniCPMv2_6-prompt-generator

https://huggingface.co/thwri/CogFlorence-2.2-Large

1724902196890

Run with:flux1-dev-Q8_0.gguf

e8ad7fa14f807184a99ea23b31e8a60

1724897220972

1724897584034