/Awesome-Image-Composition

A curated list of papers, code and resources pertaining to image composition/compositing or object insertion, which aims to generate realistic composite image.

Awesome Image Composition Awesome

A curated list of resources including papers, datasets, and relevant links pertaining to image composition (object insertion).

Contributing

Contributions are welcome. If you wish to contribute, feel free to send a pull request. If you have suggestions for new sections to be included, please raise an issue and discuss before sending a pull request.

Table of Contents

Online Demo

Try this online demo for image composition and have fun! hot

Surveys

  • Li Niu, Wenyan Cong, Liu Liu, Yan Hong, Bo Zhang, Jing Liang, Liqing Zhang: "Making Images Real Again: A Comprehensive Survey on Deep Image Composition." arXiv preprint arXiv:2106.14490 (2021). [arXiv]

Papers

1. Image Blending

Awesome-Image-Blending

2. Image Harmonization

Awesome-Image-Harmonization

3. Object Shadow Generation

Awesome-Object-Shadow-Generation

4. Object Reflection Generation

  • Daniel Winter, Matan Cohen, Shlomi Fruchter, Yael Pritch, Alex Rav-Acha, Yedid Hoshen: "ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion." arXiv preprint arXiv:2403.18818 (2024) [arXiv]
  • Shengjie Ma, Qian Shen, Qiming Hou, Zhong Ren, Kun Zhou: "Neural Compositing for Real-time Augmented Reality Rendering in Low-frequency Lighting Environments." Science China Information Sciences (2021) [pdf]

5. Object Placement

Awesome-Object-Placement

6. Occlusion

  • Jonghyun Lee, Hansam Cho, Youngjoon Yoo, Seoung Bum Kim, Yonghyun Jeong: "Compose and Conquer: Diffusion-Based 3D Depth Aware Composable Image Synthesis." arXiv preprint arXiv:2401.09048 (2024) [pdf]
  • Zan Li, Wencheng Wang, Fei Hou: "Image Composition with Depth Registration." IJCAI (2023) [paper]
  • Fangneng Zhan, Jiaxing Huang, Shijian Lu: "Hierarchy Composition GAN for High-fidelity Image Synthesis." Transactions on cybernetics (2021) [arXiv]
  • Samaneh Azadi, Deepak Pathak, Sayna Ebrahimi, Trevor Darrell: "Compositional GAN: Learning Image-Conditional Binary Composition." IJCV (2020) [arXiv] [code]

7. Resolution/Sharpness/Noise Discrepancy

  • Jizhizi Li, Jing Zhang, Stephen J.Maybank, Dacheng Tao: "Bridging Composite and Real: Towards End-to-End Deep Image Matting." IJCV (2021) [pdf] [code]

8. Foreground Object Search

Awesome-Foreground-Object-Search

9. Generative Image Composition

Awesome-Generative-Image-Composition

Datasets

  • Datasets for image harmonization [link]
  • Datasets for object shadow generation [link]
  • Datasets for object placement [link]
  • Datasets for foreground object search [link]
  • Datasets for spatial transformation [link]
  • Datasets for generative image composition [link]

Evaluation