instantX-research/IP-Adapter-for-SD3

More suitable IP-Adapter for the DiT architecture

IP-Adapter for SD3

Qixun Wang¹⁺ · Xu Bai¹⁺ · Hu Ye¹² · Haofan Wang^1*

¹InstantX Team · ²Tencent

⁺equal contribution

^*corresponding authors

IP-Adapter-for-SD3 is an adaptation scheme of IP-Adapter on stabilityai/stable-diffusion-3-medium, with the algorithmic structure highly referencing that of IP-Adapter. It is designed to maintain the basis of text editing while introducing image guidance. Image guidance includes the embedding of people, objects, and styles. It is also compatible with SD3-Controlnet-Canny, SD3-Controlnet-Tile, SD3-Controlnet-Pose, and other SD3 plugins.