really-awesome-semantic-segmentation

A list of all papers on Semantic Segmentation and the datasets they use. This site is maintained by Holger Caesar. To complement or correct it, please contact me at holger-at-it-caesar.com or visit it-caesar.com. Also checkout really-awesome-gan and our COCO-Stuff dataset.

For details which paper uses which dataset, please open the Google Drive document.

Below is a snapshot of the listed papers from April 03, 2017:

Identifier Paper title Venue Year
alvarez14wacv Large-Scale Semantic Co-Labeling of Image Sets wacv 2014
andrearczyk17arxiv Texture segmentation with Fully Convolutional Networks arxiv 2017
armeni17arxiv Joint 2D-3D-Semantic Data for Indoor Scene Understanding arxiv 2017
arnab16bmvc Bottom-up Instance Segmentation using Deep Higher-Order CRFs bmvc 2016
arnab16eccv Higher Order Potentials in End-to-End Trainable Conditional Random Fields eccv 2016
audebert17urse Fusion of Heterogeneous Data in Convolutional Networks for Urban Semantic Labeling urse 2017
badrinarayanan15arxiv Segnet: A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling arxiv 2015
bai16arxiv Deep Watershed Transform for Instance Segmentation arxiv 2016
bansal17arxiv PixelNet: Representation of the pixels, by the pixels, and for the pixels. arxiv 2017
barnes17icra Find Your Own Way: Weakly-Supervised Segmentation of Path Proposals for Urban Autonomy arxiv 2017
batra08cvpr Learning Class-Specific Affinities for Image Labelling cvpr 2008
bell15cvpr Material recognition in the wild with the materials in context database cvpr 2015
bergbauer13report Morphological Proximity Priors: Spatial Relationships for Semantic Segmentation report 2013
bertasius16arxiv Convolutional Random Walk Networks for Semantic Image Segmentation arxiv 2016
bertasius16cvpr Semantic Segmentation with Boundary Neural Fields cvpr 2016
boix12ijcv Harmony potentials: Fusing global and local scale for semantic image segmentation ijcv 2012
bratieres14icml Scalable Gaussian Process Structured Prediction for Grid Factor Graph Applications icml 2014
brahmbatt17wacv StuffNet: Using Stuff to Improve Object Detection wacv 2017
brust15cvprw Efficient Convolutional Patch Networks for Scene Understanding cvprw 2015
brust15visapp Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding visapp 2015
bulo14cvpr Neural Decision Forests for Semantic Image Labelling cvpr 2014
byeon15cvpr Scene Labeling with LSTM Recurrent Neural Networks cvpr 2015
cadena14icra Semantic segmentation with heterogeneous sensor coverages icra 2014
caesar15bmvc Joint Calibration for Semantic Segmentation bmvc 2015
caesar16arxiv COCO-Stuff : Thing and Stuff Classes in Context arxiv 2016
caesar16eccv Region-based semantic segmentation with end-to-end training eccv 2016
caltagirone17arxiv Fast LIDAR-based Road Detection Using Convolutional Neural Networks arxiv 2017
campbell97pr nterpreting image databases by region classification pr 1997
cao16arxiv Exploiting Depth from Single Monocular Images for Object Detection and Semantic Segmentation arxiv 2016
carreira10cvpr Constrained Parametric Min-Cuts for Automatic Object Segmentation cvpr 2010
carreira12eccv Semantic Segmentation with Second-Order Pooling eccv 2012
carreira14pami Freeform region description with second-order pooling pami 2014
chandra16arxiv Fast, Exact and Multi-Scale Inference for Semantic Image Segmentation with Deep Gaussian CRFs arxiv 2016
chen15arxiv Attention to Scale: Scale-aware Semantic Image Segmentation arxiv 2015
chen16iclr Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs iclr 2016
cimpoi15cvpr Deep filter banks for texture recognition, description, and segmentation cvpr 2015
cogswell14arxiv Combining the Best of Graphical Models and ConvNets for Semantic Segmentation arxiv 2014
curto17arxiv HashBox: Hash Hierarchical Segmentation exploiting Bounding Box Object Detection arxiv 2017
dai15arxiv BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation arxiv 2015
dai16cvpr Instance-aware Semantic Segmentation via Multi-task Network Cascades cvpr 2015
dai15cvpr Convolutional Feature Masking for Joint Object and Stuff Segmentation cvpr 2015
dai16arxiv Instance-sensitive Fully Convolutional Networks arxiv 2016
dealvis17arxiv Urban Scene Segmentation with Laser-Constrained CRFs arxiv 2017
dong14eccv Towards Unified Object Detection and Semantic Segmentation eccv 2014
eigen12cvpr Nonparametric image parsing using adaptive neighbor sets cvpr 2012
eigen15iccv Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture iccv 2015
farabet12icml Scene Parsing with Multiscale Feature Learning, Purity trees, and Optimal Covers icml 2012
farabet13pami Learning Hierarchical Features for Scene Labeling pami 2013
fathi17arxiv Semantic Instance Segmentation via Deep Metric Learning arxiv 2017
fayyaz16arxiv STFCN: Spatio-Temporal FCN for Semantic Video Segmentation arxiv 2016
freytag12icpr Efficient Semantic Segmentation with Gaussian Processes and Histogram Intersection Kernels icpr 2012
froehlich10icpr A Fast Approach for Pixelwise Labeling of Facade Images icpr 2010
froehlich12accv Semantic Segmentation with Millions of Features: Integrating Multiple Cues in a Combined Random Forest Approach accv 2012
froehlich12dagm As Time Goes By — Anytime Semantic Segmentation with Iterative Context Forests dagm 2012
gadde16eccv Superpixel Convolutional Networks using Bilateral Inceptions eccv 2016
gatta14cvpr Unrolling loopy top-down semantic feedback in convolutional deep networks cvpr 2014
george15cvpr Image Parsing with a Wide Range of Classes and Scene-Level Context cvpr 2015
ghiasi16eccv Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation eccv 2016
girshick14cvpr Rich feature hierarchies for accurate object detection and semantic segmentation cvpr 2014
gould09iccv Decomposing a scene into geometric and semantically consistent regions iccv 2009
gould12eccv PatchMatchGraph: Building a Graph of Dense Patch Correspondences for Label Transfer eccv 2012
guillaumin13cvpr Fast Energy Minimization using Learned State Filters cvpr 2013
hariharan14eccv Simultaneous Detection and Segmentation eccv 2014
hariharan15cvpr Hypercolumns for object segmentation and fine-grained localization cvpr 2015
harley16iclrw Learning Dense Convolutional Embeddings for Semantic Segmentation iclrw 2015
hayder16arxiv Shape-aware Instance Segmentation arxiv 2016
he16arxiv RGBD Semantic Segmentation Using Spatio-Temporal Data-Driven Pooling arxiv 2016
he17arxiv Mask R-CNN arxiv 2017
hoeft14ki Fast Semantic Segmentation of RGB-D Scenes with GPU-Accelerated Deep Neural Networks ki 2014
hoffman16arxiv FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptation arxiv 2016
hong15arxiv Decoupled Deep Neural Network for Semi-supervised Semantic Segmentation arxiv 2015
hong16cvpr Learning Transferrable Knowledge for Semantic Segmentation with Deep Convolutional Neural Network cvpr 2016
hou16arxiv Mining Pixels: Weakly Supervised Semantic Segmentation Using Image Labels arxiv 2016
hong17arxiv Weakly Supervised Semantic Segmentation using Web-Crawled Videos arxiv 2017
huang16arxiv Object Boundary Guided Semantic Segmentation arxiv 2016
huang16arxiv Scene Labeling using Recurrent Neural Networks with Explicit Long Range Contextual Dependency arxiv 2016
huang17arxiv Scene Labeling using Gated Recurrent Units with Explicit Long Range Conditioning arxiv 2017
hur16eccvw Joint Optical Flow and Temporally Consistent Semantic Segmentation eccvw 2016
hu16arxiv Recalling Holistic Information for Semantic Segmentation arxiv 2016
hu17arxiv LabelBank: Revisiting Global Perspectives for Semantic Segmentation arxiv 2017
husain16icra Combining Semantic and Geometric Features for Object Class Segmentation of Indoor Scenes icra 2016
ion11nips Probabilistic joint image segmentation and labeling nips 2011
islam17arxiv Label Refinement Network for Coarse-to-Fine Semantic Segmentation arxiv 2017
jafari17arxiv Analyzing Modular CNN Architectures for Joint Depth Prediction and Semantic Segmentation arxiv 2017
javanmardi16arxiv Unsupervised Total Variation Loss for Semi-supervised Deep Learning of Semantic Segmentation arxiv 2016
jegou16arxiv The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation arxiv 2016
jian09cvpr Efficient Scale Space Auto-Context for Image Segmentation and Labeling cvpr 2009
jin16arxiv Multi-Path Feedback Recurrent Neural Network for Scene Parsing arxiv 2016
jin16arxiv Object Detection Free Instance Segmentation With Labeling Transformations arxiv 2016
kekec14bmvc Contextually Constrained Deep Networks for Scene Labeling bmvc 2014
kemker17arxiv High-Resolution Multispectral Dataset for Semantic Segmentation arxiv 2017
kemker17arxiv Deep Neural Networks for Semantic Segmentation of Multispectral Remote Sensing Imagery arxiv 2017
kendall15arxiv Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding arxiv 2015
khoreva16arxiv Weakly Supervised Semantic Labelling and Instance Segmentation arxiv 2016
khoreva16arxiv Simple Does It: Weakly Supervised Instance and Semantic Segmentation arxiv 2016
kim16arxiv Scale-Invariant Feature Learning using Deconvolutional Neural Networks for Weakly-Supervised Semantic Segmentation arxiv 2016
kim17arxiv A New Convolutional Network-in-Network Structure and Its Applications in Skin Detection, Semantic Segmentation, and Artifact Reduction arxiv 2017
kokkinos16iclr Pushing the Boundaries of Boundary Detection Using Deep Learning iclr 2016
kokkinos16arxiv UberNet : Training a ‘Universal’ Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memory arxiv 2016
kolesnikov16arxiv Improving Weakly-Supervised Object Localization By Micro-Annotation arxiv 2016
kraehenbuehl11nips Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials nips 2011
kumar10cvpr Efficiently Selecting Regions for Scene Understanding cvpr 2010
kundu16cvpr Feature Space Optimization for Semantic Video Segmentation cvpr 2016
ladicky09iccv Associative Hierarchical CRFs for Object Class Image Segmentation iccv 2009
ladicky10bmvc Joint Optimisation for Object Class Segmentation and Dense Stereo Reconstruction bmvc 2010
ladicky10eccv Graph cut based inference with co-occurrence statistics eccv 2010
ladicky12ijcv Joint Optimization for Object Class Segmentation and Dense Stereo Reconstruction ijcv 2012
larius10ijcv Category Level Object Segmentation by Combining Bag-of-Words Models with Dirichlet Processes and Random Fields ijcv 2010
larsson17arxiv Learning Arbitrary Potentials in CRFs with Gradient Descent arxiv 2017
lempitsky11nips A Pylon Model for Semantic Segmentation nips 2011
li13cvpr Composite Statistical Inference for Semantic Segmentation cvpr 2013
li16arxiv Iterative Instance Segmentation arxiv 2016
li16arxiv RGB-D Scene Labeling with Long Short-Term Memorized Fusion Model arxiv 2016
liang16cvpr Semantic Object Parsing with Local-Global Long Short-Term Memory cvpr 2016
lim09iccv Context by region ancestry iccv 2009
lin16arxiv RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation arxiv 2016
lin16cvpr Efficient piecewise training of deep structured models for semantic segmentation cvpr 2016
lin15nips Deeply Learning the Messages in Message Passing Inference nips 2015
lin16arxiv Exploring Context with Deep Structured models for Semantic Segmentation arxiv 2016
lin16arxiv ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentation arxiv 2016
lin16cvpr Deep Structured Scene Parsing by Learning with Image Descriptions cvpr 2016
liu11pami Nonparametric Scene Parsing via Label Transfer pami 2011
liu14wacv Joint Semantic and Geometric Segmentation of Videos with a Stage Model wacv 2014
liu15arxiv ParseNet: Looking Wider to See Better arxiv 2015
liu15cvpr Multiclass Semantic Video Segmentation with Object-level Active Inference cvpr 2015
liu15iccv Semantic Image Segmentation via Deep Parsing Network iccv 2015
liu15rss Layered Interpretation of Street View Images rss 2015
liu15wacv Multi-class Semantic Video Segmentation with Exemplar-based Object Reasoning wacv 2015
liu16arxiv Discriminative Training of Deep Fully-connected Continuous CRFs with Task-specific Loss arxiv 2016
long15cvpr Fully Convolutional Networks for Semantic Segmentation cvpr 2015
long16pami Fully Convolutional Networks for Semantic Segmentation pami 2016
luc16nipsw emantic Segmentation using Adversarial Networks nipsw 2016
lucchi11iccv Are Spatial and Global Constraints Really Necessary for Segmentation? iccv 2011
maninis16eccv Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks eccv 2016
marmanis16arxiv Classification with an edge: improving semantic image segmentation with boundary detection arxiv 2016
meier17arxiv Perturb-and-MPM: Quantifying Segmentation Uncertainty in Dense Multi-Label CRFs arxiv 2017
mostajabi14mva A robust multilevel segment description for multi-class object recognition mva 2014
mostajabi15cvpr Feedforward semantic segmentation with zoom-out features cvpr 2015
mostajabi16arxiv Diverse Sampling for Self-Supervised Learning of Semantic Segmentation arxiv 2016
mottaghi14cvpr The Role of Context for Object Detection and Semantic Segmentation in the Wild cvpr 2014
mousavian16arxiv Joint Semantic Segmentation and Depth Estimation with Deep Convolutional Networks arxiv 2016
mueller14icra Learning Depth-Sensitive Conditional Random Fields for Semantic Segmentation of RGB-D Images icra 2014
munoz10eccv Stacked hierarchical labeling eccv 2010
mustikovela16arxiv Can Ground Truth Label Propagation from Video help Semantic Segmentation? arxiv 2016
najafi16arxiv Sample and Filter: Nonparametric Scene Parsing via Efficient Filtering arxiv 2016
nekrasov16bmvc Global Deconvolutional Networks for Semantic Segmentation bmvc 2016
neverova17arxiv Predicting Deeper into the Future of Semantic Segmentation arxiv 2017
noh15arxiv Learning Deconvolution Network for Semantic Segmentation arxiv 2015
osep16icra "Multi-Scale Object Candidates for Generic Object Tracking in Street
Scenes" icra 2016
papandreou15iccv Weakly- and Semi-Supervised Learning of a Deep Convolutional Network for Semantic Image Segmentation iccv 2015
paszke16arxiv ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation arxiv 2016
pathak15iccv Constrained Convolutional Neural Networks for Weakly Supervised Segmentation iccv 2015
pathak15iclr Fully Convolutional Multi-Class Multipe Instance Learning iclr 2015
pavel15ijcnn Recurrent Convolutional Neural Networks for Object-Class Segmentation of RGB-D Video ijcnn 2015
pinheiro15cvpr From Image-level to Pixel-level Labeling with Convolutional Networks cvpr 2015
pinheiro15icml Recurrent Convolutional Neural Networks for Scene Parsing icml 2015
plath09icml Multi-class image segmentation using Conditional Random Fields and Global Classification icml 2009
pohlen16arxiv Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes arxiv 2016
ren16arxiv End-to-End Instance Segmentation with Recurrent Attention arxiv 2016
reza16arxiv Reinforcement Learning for Semantic Segmentation in Indoor Scenes arxiv 2016
richter16eccv Playing for Data: Ground Truth from Computer Games eccv 2016
ros16arxiv Training Constrained Deconvolutional Networks for Road Scene Semantic Segmentation arxiv 2016
rubinstein12eccv Annotation Propagation in Large Image Databases via Dense Image Correspondence eccv 2012
saito15cvpr Transformation of Markov Random Fields for Marginal Distribution Estimation cvpr 2015
saleh16arxiv Built-in Foreground/Background Prior for Weakly-Supervised Semantic Segmentation arxiv 2016
saleh16dicta Kangaroo Vehicle Collision Detection Using Deep Semantic Segmentation Convolutional Neural Network dicta 2016
schwing15arxiv Fully connected deep structured networks arxiv 2015
schulz12esann Learning Object-Class Segmentation with Convolutional Neural Networks esann 2012
schulz15esann Depth and Height Aware Semantic RGB-D Perception with Convolutional Neural Networks esann 2015
schulz15isapp CURFIL: Random Forests for Image Labeling on GPU isapp 2015
shafaei16bmvc Play and Learn: Using Video Games to Train Computer Vision Models bmvc 2016
sharma14nips Recursive Context Propagation Network for Semantic Scene Labeling nips 2014
sharma15cvpr Deep Hierarchical Parsing for Semantic Segmentation cvpr 2015
shelhamer16arxiv Clockwork Convnets for Video Semantic Segmentation arxiv 2016
shen16arxiv Fast Semantic Image Segmentation with High Order Context and Guided Filtering arxiv 2016
shen17arxiv Learning Multi-level Region Consistency with Dense Multi-label Networks for Semantic Segmentation arxiv 2017
shotton06eccv TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-Class Object Recognition and Segmentation eccv 2006
shotton08cvpr Semantic texton forests for image categorization and segmentation cvpr 2008
shotton09ijcv Textonboost for image understanding: Multi-class object recognition and segmentation by jointly modeling texture, layout, and context ijcv 2009
shuai15cvpr Integrating Parametric and Non-parametric Models For Scene Labeling cvpr 2015
shuai16arxiv Improving Fully Convolution Network for Semantic Segmentation arxiv 2016
shuai16cvpr DAG - Recurrent Neural Networks for Scene Labeling cvpr 2016
shuai16tip Scene Parsing With Integration of Parametric and Non-Parametric Models tip 2016
singh13cvpr Nonparametric scene parsing with adaptive feature relevance and semantic context cvpr 2013
socher11icml Parsing natural scenes and natural language with recursive neural networks icml 2011
souly17arxiv Semi and Weakly Supervised Semantic Segmentation Using Generative Adversarial Network arxiv 2017
sturgess09bmvc Combining Appearance and Structure from Motion Features for Road Scene Understanding bmvc 2009
sturgess12bmvc Scalable Cascade Inference for Semantic Image Segmentation bmvc 2012
sun13pami Relating Things and Stuff via Object Property Interactions. pami 2013
tighe10eccv Superparsing: Scalable Nonparametric Image Parsing with Superpixels eccv 2010
tighe11iccv Understanding Scenes on Many Levels iccv 2011
tighe13cvpr Finding Things: Image Parsing with Regions and Per-Exemplar Detectors cvpr 2013
tighe13ijcv Superparsing - Scalable Nonparametric Image Parsing with Superpixels ijcv 2013
tighe14cvpr Scene parsing with object instances and occlusion ordering cvpr 2014
tokmakov16eccv Weakly-Supervised Semantic Segmentation using Motion Cues eccv 2016
tripathi15arxiv Semantic Video Segmentation: Exploring Inference Efficiency arxiv 2015
tschannen17arxiv Deep Structured Features for Semantic Segmentation arxiv 2016
tu08cvpr Auto-context and Its Application to High-level Vision Tasks cvpr 2008
tu10pami Auto-context and Its Application to High-level Vision Tasks and 3D Brain Image Segmentation pami 2010
uhrig2016arxiv Pixel-level Encoding and Depth Layering for Instance-level Semantic Labeling arxiv 2016
veeravasarapu17arxiv Adversarially Tuned Scene Generation arxiv 2017
vemulapalli16cvpr Gaussian Conditional Random Field Network for Semantic Segmentation cvpr 2016
verbeek07cvpr Region Classification with Markov Field Aspect Models cvpr 2007
verbeek07nips Scene Segmentation with Conditional Random Fields Learned from Partially Labeled Images nips 2007
vernaza16arxiv Variational reaction-diffusion systems for semantic segmentation arxiv 2016
vezhnevets10cvpr Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning cvpr 2010
vezhnevets11iccv Weakly Supervised Semantic Segmentation with a Multi-Image Model iccv 2011
vezhnevets12cvpr Weakly Supervised Structured Output Learning for Semantic Segmentation cvpr 2012
visin16cvprw ReSeg : A Recurrent Neural Network-based Model for Semantic Segmentation cvprw 2016
volpi16igarss Semantic Labeling of Aerial Images by Learning Class-Specific Object Proposals igarss 2016
wang16eccv Learning Common and Specific Features for RGB-D Semantic Segmentation with Deconvolutional Networks eccv 2016
wang17arxiv Understanding Convolution for Semantic Segmentation arxiv 2017
wei16pami STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation pami 2015
wei17arxiv Object Region Mining with Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach arxiv 2017
weijer07iccv Using High-Level Visual Information for Color Constancy iccv 2007
wen16arxiv Training Bit Fully Convolutional Network for Fast Semantic Segmentation arxiv 2016
wong17arxiv SegICP: Integrated Deep Semantic Segmentation and Pose Estimation arxiv 2017
wu16arxiv Bridging Category-level and Instance-level Semantic Image Segmentation arxiv 2016
wu16arxiv High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks arxiv 2016
xia12eccv Segmentation over Detection by Coupled Global and Local Sparse Representations eccv 2012
xiaodan15arxiv Proposal-free Network for Instance-level Object Segmentation arxiv 2015
xie17arxiv Adversarial Examples for Semantic Segmentation and Object Detection arxiv 2017
xu14cvpr Tell Me What You See and I Will Show You Where It Is cvpr 2014
xu15cvpr Learning to Segment Under Various Forms of Weak Supervision cvpr 2015
yan16arxiv Combining the Best of Convolutional Layers and Recurrent Layers: A Hybrid Network for Semantic Segmentation arxiv 2016
yang07cvpr Multiple Class Segmentation Using A Unified Framework over Mean-Shift Patches. cvpr 2007
yang14cvpr Context Driven Scene Parsing with Attention to Rare Classes cvpr 2014
yao12cvpr Describing the Scene as a Whole: Joint Object Detection, Scene Classification and Semantic Segmentation cvpr 2012
yu16iclr Multi-Scale Context Aggregation by Dilated Convolutions iclr 2016
yu16isvc Rare Class Oriented Scene Labeling Using CNN Incorporated Label Transfer isvc 2016
zhang14tm Representative Discovery of Structure Cues for Weakly-Supervised Image Segmentation tm 2014
zhang15cvpr Weakly Supervised Semantic Segmentation for Social Images cvpr 2015
zhang15icra Sensor fusion for semantic segmentation of urban scenes icra 2015
zhang16arxiv Instance-Level Segmentation with Deep Densely Connected MRFs arxiv 2016
zhang16arxiv Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks arxiv 2016
zhao16arxiv Better Image Segmentation by Exploiting Dense Semantic Predictions arxiv 2016
zhao17arxiv A deep learning model integrating FCNNs and CRFs for brain tumor segmentation arxiv 2017
zhao17arxiv Open Vocabulary Scene Parsing arxiv 2017
zheng15iccv Conditional Random Fields as Recurrent Neural Networks iccv 2015
zhou16arxiv Semantic Understanding of Scenes through the ADE20K Dataset arxiv 2016