Awesome-Referring-Image-Segmentation
A collection of referring image segmentation papers and datasets.
Feel free to create a PR or an issue.
Outline
1. Datasets
| Short name | Paper | Source | Code/Project Link |
|---|---|---|---|
| ReferIt | Referit game: Referring to objects in photographs of natural scenes | EMNLP 2014 | [project] |
| Google-Ref | Generation and comprehension of unambiguous object descriptions | CVPR 2016 | [dataset] |
| UNC | Modeling context in referring expressions | ECCV 2016 | [dataset] |
| UNC+ | Modeling context in referring expressions | ECCV 2016 | [dataset] |
| CLEVR-Ref+ | CLEVR-Ref+: Diagnosing Visual Reasoning with Referring Expressions | CVPR 2019 | [project] |
2. Methods
| Short name | Paper | Source | Code/Project Link |
|---|---|---|---|
| - | Dual Convolutional LSTM Network for Referring Image Segmentation | TMM 2020 | |
| STEP | See-Through-Text Grouping for Referring Image Segmentation | ICCV 2019 | |
| lang2seg | Referring Expression Object Segmentation with Caption-Aware Consistency | BMVC 2019 | [code] |
| CMSA | Cross-Modal Self-Attention Network for Referring Image Segmentation | CVPR 2019 | [code] |
| KWA | Key-Word-Aware Network for Referring Expression Image Segmentation | ECCV 2018 | [code] |
| DMN | Dynamic Multimodal Instance Segmentation Guided by Natural Language Queries | ECCV 2018 | [code] |
| RRN | Referring Image Segmentation via Recurrent Refinement Networks | CVPR 2018 | [code] |
| MAttNet | MAttNet: Modular Attention Network for Referring Expression Comprehension | CVPR 2018 | [code] [Demo] |
| RMI | Recurrent Multimodal Interaction for Referring Image Segmentation | ICCV 2017 | [code] |
| LSTM-CNN | Segmentation from natural language expressions | ECCV 2016 | [code] [project] |