/awesome-anomaly-detection

A curated list of awesome anomaly detection resources

awesome anomaly detection

A curated list of awesome anomaly detection resources. Inspired by awesome-architecture-search and awesome-automl.

Last updated: 2020/01/16

What is anomaly detection?

Anomaly detection is a technique used to identify unusual patterns that do not conform to expected behavior, called outliers. Typically, this is treated as an unsupervised learning problem where the anomalous samples are not known a priori and it is assumed that the majority of the training dataset consists of “normal” data (here and elsewhere the term “normal” means not anomalous and is unrelated to the Gaussian distribution). [Lukas Ruff et al., 2018; Deep One-Class Classification]

In general, Anomaly detection is also called Novelty Detection or Outlier Detection, Forgery Detection and Out-of-distribution Detection.

Each term has slightly different meanings. Mostly, on the assumption that you do not have unusual data, this problem is especially called One Class Classification, One Class Segmentation.

and Novelty Detection and Outlier Detection have slightly different meanings. Figure below shows the differences of two terms.

Also, there are two types of target data. (time-series data, and image data)
In time-series data, it is aimed to detect a abnormal sections or frames in input data. (ex, videos, signal, etc)
In image data, it is aimed to classify abnormal images or to segment abnormal regions, for example, defect in some manufacturing data.

Survey Paper

  • Deep Learning for Anomaly Detection: A Survey | Raghavendra Chalapathy, Sanjay Chawla | [arXiv' 19] |[pdf]

Table of Contents

Time-series anomaly detection (need to survey more..)

  • Anomaly Detection of Time Series | [Thesis' 10] |[pdf]
  • Long short term memory networks for anomaly detection in time series | [ESANN' 15] |[pdf]
  • LSTM-Based System-Call Language Modeling and Robust Ensemble Method for Designing Host-Based Intrusion Detection Systems | [arXiv' 16] | [pdf]
  • Time Series Anomaly Detection; Detection of anomalous drops with limited features and sparse examples in noisy highly periodic data | [arXiv' 17] | [pdf]
  • Abnormal Event Detection in Videos using Spatiotemporal Autoencoder | [ISNN' 17] | [pdf]
  • Anomaly Detection in Multivariate Non-stationary Time Series for Automatic DBMS Diagnosis | [ICMLA' 17] | [pdf]
  • Real-world Anomaly Detection in Surveillance Videos | [arXiv' 18] | [pdf] [project page]
  • Unsupervised Anomaly Detection for Traffic Surveillance Based on Background Modeling | [CVPR Workshop' 18] | [pdf]
  • Dual-Mode Vehicle Motion Pattern Learning for High Performance Road Traffic Anomaly Detection | [CVPR Workshop' 18] | [pdf]
  • Truth Will Out: Departure-Based Process-Level Detection of Stealthy Attacks on Control Systems | [ACM CCS '18] | [pdf]
  • Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos | [CVPR' 19] | [pdf]
  • Challenges in Time-Stamp Aware Anomaly Detection in Traffic Videos | [CVPRW' 19] | [pdf]
  • Motion-Aware Feature for Improved Video Anomaly Detection | [BMVC' 19] | [pdf]
  • Time-Series Anomaly Detection Service at Microsoft | [KDD' 19] | [pdf]
  • A Systematic Evaluation of Deep Anomaly Detection Methods for Time Series | Under Review | [code]
  • MIDAS: Microcluster-Based Detector of Anomalies in Edge Streams | [AAAI' 20] | [pdf] [code]

Image-level anomaly detection

One Class (Anomaly) Classification target

  • Estimating the Support of a High- Dimensional Distribution [OC-SVM] | [Journal of Neural Computation' 01] | [pdf]
  • A Survey of Recent Trends in One Class Classification | [AICS' 09] | [pdf]
  • Anomaly detection using autoencoders with nonlinear dimensionality reduction | [MLSDA Workshop' 14] | [link]
  • A review of novelty detection | [Signal Processing' 14] | [link]
  • Variational Autoencoder based Anomaly Detection using Reconstruction Probability | [SNU DMC Tech' 15] | [pdf]
  • High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning | [Pattern Recognition' 16] | [link]
  • Transfer Representation-Learning for Anomaly Detection | [ICML' 16] | [pdf]
  • Outlier Detection with Autoencoder Ensembles | [SDM' 17] | [pdf]
  • Provable self-representation based outlier detection in a union of subspaces | [CVPR' 17] | [pdf]
  • [ALOCC]Adversarially Learned One-Class Classifier for Novelty Detection | [CVPR' 18] | [pdf] [code]
  • Learning Deep Features for One-Class Classification | [arXiv' 18] | [pdf] [code]
  • Efficient GAN-Based Anomaly Detection | [arXiv' 18] | [pdf]
  • Hierarchical Novelty Detection for Visual Object Recognition | [CVPR' 18] | [pdf]
  • Deep One-Class Classification | [ICML' 18] | [pdf]
  • Reliably Decoding Autoencoders’ Latent Spaces for One-Class Learning Image Inspection Scenarios | [OAGM Workshop' 18] | [pdf]
  • q-Space Novelty Detection with Variational Autoencoders | [arXiv' 18] | [pdf]
  • GANomaly: Semi-Supervised Anomaly Detection via Adversarial Training | [ACCV' 18] | [pdf]
  • Deep Anomaly Detection Using Geometric Transformations | [NIPS' 18] | [pdf]
  • Generative Probabilistic Novelty Detection with Adversarial Autoencoders | [NIPS' 18] | [pdf]
  • A loss framework for calibrated anomaly detection | [NIPS' 18] | [pdf]
  • A Practical Algorithm for Distributed Clustering and Outlier Detection | [NIPS' 18] | [pdf]
  • Efficient Anomaly Detection via Matrix Sketching | [NIPS' 18] | [pdf]
  • Adversarially Learned Anomaly Detection | [IEEE ICDM' 18] | [pdf]
  • Anomaly Detection With Multiple-Hypotheses Predictions | [ICML' 19] | [pdf]
  • Exploring Deep Anomaly Detection Methods Based on Capsule Net | [ICMLW' 19] | [pdf]
  • Latent Space Autoregression for Novelty Detection | [CVPR' 19] | [pdf]
  • OCGAN: One-Class Novelty Detection Using GANs With Constrained Latent Representations | [CVPR' 19] | [pdf]
  • Unsupervised Learning of Anomaly Detection from Contaminated Image Data using Simultaneous Encoder Training | [arXiv' 19] | [pdf]
  • Classification-Based Anomaly Detection for General Data | [ICLR' 20] | [pdf]
  • Robust Subspace Recovery Layer for Unsupervised Anomaly Detection | [ICLR' 20] | [pdf]
  • RaPP: Novelty Detection with Reconstruction along Projection Pathway | [ICLR' 20] | [pdf]
  • Novelty Detection Via Blurring | [ICLR' 20] | [pdf]
  • Deep Semi-Supervised Anomaly Detection | [ICLR' 20] | [pdf]
  • Robust anomaly detection and backdoor attack detection via differential privacy | [ICLR' 20] | [pdf]

Multi-Class Out-of-Distribution(OOD) Detction target

  • A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks | [ICLR' 17] | [pdf]
  • [ODIN] Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networks | [ICLR' 18] | [pdf]
  • Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samples | [ICLR' 18] | [pdf]
  • Learning Confidence for Out-of-Distribution Detection in Neural Networks | [arXiv' 18] | [pdf]
  • Out-of-Distribution Detection using Multiple Semantic Label Representations | [NIPS' 18] | [pdf]
  • A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks | [NIPS' 18] | [pdf]
  • Deep Anomaly Detection with Outlier Exposure | [ICLR' 19] | [pdf]
  • Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problem | [CVPR' 19] | [pdf]
  • Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty | [NeurIPS' 19] | [pdf] [code]
  • Outlier Exposure with Confidence Control for Out-of-Distribution Detection | [arXiv' 19] | [pdf] [code]
  • Learning to Balance: Bayesian Meta-Learning for Imbalanced and Out-of-distribution Tasks | [ICLR' 20] | [pdf]
  • Input Complexity and Out-of-distribution Detection with Likelihood-based Generative Models | [ICLR' 20] | [pdf]

One Class (Anomaly) Segmentation target

  • Anomaly Detection and Localization in Crowded Scenes | [TPAMI' 14] | [pdf]
  • Novelty detection in images by sparse representations | [IEEE Symposium on IES' 14] | [link]
  • Detecting anomalous structures by convolutional sparse models | [IJCNN' 15] | [pdf]
  • Real-Time Anomaly Detection and Localization in Crowded Scenes | [CVPR Workshop' 15] | [pdf]
  • Learning Deep Representations of Appearance and Motion for Anomalous Event Detection | [BMVC' 15] | [pdf]
  • Scale-invariant anomaly detection with multiscale group-sparse models | [IEEE ICIP' 16] | [link]
  • [AnoGAN] Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery | [IPMI' 17] | [pdf]
  • Deep-Anomaly: Fully Convolutional Neural Network for Fast Anomaly Detection in Crowded Scenes | [Journal of Computer Vision and Image Understanding' 17] | [pdf]
  • Anomaly Detection using a Convolutional Winner-Take-All Autoencoder | [BMVC' 17] | [pdf]
  • Anomaly Detection in Nanofibrous Materials by CNN-Based Self-Similarity | [Sensors' 17] | [pdf]
  • Defect Detection in SEM Images of Nanofibrous Materials | [IEEE Trans. on Industrial Informatics' 17] | [pdf]
  • Abnormal event detection in videos using generative adversarial nets | [ICIP' 17] | [link]
  • An overview of deep learning based methods for unsupervised and semi-supervised anomaly detection in videos | [arXiv' 18] | [pdf]
  • Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders | [arXiv' 18] | [pdf]
  • Satellite Image Forgery Detection and Localization Using GAN and One-Class Classifier | [IS&T EI' 18] | [pdf]
  • Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images | [arXiv' 18] | [pdf]
  • AVID: Adversarial Visual Irregularity Detection | [arXiv' 18] |[pdf]
  • MVTec AD -- A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection | [CVPR' 19] | [pdf]
  • Exploiting Epistemic Uncertainty of Anatomy Segmentation for Anomaly Detection in Retinal OCT | [IEEE TMI' 19] | [pdf]
  • Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings | [arXiv' 19] | [pdf]
  • Attention Guided Anomaly Detection and Localization in Images | [arXiv' 19] | [pdf]

Contact & Feedback

If you have any suggenstions about papers, feel free to mail me :)