pix2gestalt: Amodal Segmentation by Synthesizing Wholes

In Submission

Project Page | Paper | arXiv

pix2gestalt: Amodal Segmentation by Synthesizing Wholes
Ege Ozguroglu¹, Ruoshi Liu¹, Dídac Surís¹, Dian Chen², Achal Dave², Pavel Tokmakov², Carl Vondrick¹
¹Columbia University, ²Toyota Research Institute

Updates

Our paper is now available on arXiv!
Pre-trained weights and preliminary Gradio demo coming soon.
Stay tuned for the release of our training & inference scripts!

Citation

If you use this code, please consider citing the paper as:

@misc{ozguroglu2024pix2gestalt,
      title={pix2gestalt: Amodal Segmentation by Synthesizing Wholes}, 
      author={Ege Ozguroglu and Ruoshi Liu and Dídac Surís and Dian Chen and Achal Dave and Pavel Tokmakov and Carl Vondrick},
      year={2024},
      eprint={2401.14398},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Acknowledgement

This research is based on work partially supported by the Toyota Research Institute, the DARPA MCS program under Federal Agreement No. N660011924032, the NSF NRI Award #1925157, and the NSF AI Institute for Artificial and Natural Intelligence Award #2229929. DS is supported by the Microsoft PhD Fellowship.