/Comfyui_CXH_joy_caption

Recommended based on comfyui node pictures:Joy_caption + MiniCPMv2_6-prompt-generator + florence2

Primary LanguagePythonApache License 2.0Apache-2.0

.2024-10-16 添加批量打标：4090大概4~5秒一张图

批量打标

1729064090078

.2024-10-12 添加joy alpha2

模型下载：https://pan.baidu.com/s/1dOjbUEacUOhzFitAQ3uIeQ?pwd=4ypv#list/path=%2F

Joy_caption_alpha 放到 models\Joy_caption_alpha 下载：https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two/tree/main/cgrkzexw-599808

1728728834716

joy_alpha

.2024-9-9 florence2 Add Florence-2-large-PromptGen-v1.5 and MiniCPM3-4B(CXH_MinCP3_4B_Load CXH_MinCP3_4B_Chat) MiniCPM3-4B聊天 翻译，改写都很强

.2024-9-6 florence2 Add Florence-2-base-PromptGen-v1.5

.2024-9-2 更新批量打标案例(Update batch marking cases) 速度：florence2<min2.6<joy

1724901350282

(1).基于comfyui节点图片放推(Recommended based on comfyui node pictures)

1.Joy_caption

2.miniCPMv2_6_prompt_generator

3.florence2

(2).安装(Installation)：

1.（Comfyui evn python.exe） python -m pip install -r requirements.txt or click install_req.bat

注意：transformers 版本不能太低（Note: The version of transformers cannot be too low）

  1. 下载模型或者运行comfyui自动下载模型到合适文件夹(Download the model or run Comfyui to automatically download the model to the appropriate folder)

(3) 模型安装（Install model）

1).Joy_caption

.运行自动下载模型(推荐手动下载) Run automatic download model (manual download recommended)

1.https://huggingface.co/google/siglip-so400m-patch14-384 放到(put in)clip/siglip-so400m-patch14-384

1724901434148

2. https://huggingface.co/unsloth/Meta-Llama-3.1-8B-bnb-4bit 放到(put in)LLM/Meta-Llama-3.1-8B-bnb-4bit

1724901495135

3.必须手动下载(Must be downloaded manually):https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main/wpkklhc6   (put in)Joy_caption

1724901527482

2).MiniCPMv2_6-prompt-generator + CogFlorence

https://huggingface.co/pzc163/MiniCPMv2_6-prompt-generator

https://huggingface.co/thwri/CogFlorence-2.2-Large

1724902196890

Run with:flux1-dev-Q8_0.gguf

e8ad7fa14f807184a99ea23b31e8a60

1724897220972

1724897584034