shervinmin/awesome-deep-learning-survey-papers

In this page, I will provide a list of survey papers on topics related to deep learning and its applications in various fields.

Awesome- Deep Learning Related Survey Papers

In this page, I will provide a curated list of survey papers on topics related to deep learning and its applications in various fields, including computer vision, natural language processing, speech recognition, healthcare and more. Due to the large volume of works published in deep learning area, I try to keep track of comprehensive survey papers published (or under review) in top journals. If there is a paper missing here, please email me (at shervin.minaee@gmail.com) the paper title and journal, and I would be happy to include it in this list.

Background

Deep learning models have been applied to various tasks/application from different areas in the past 8-9 years, and there are countless papers written on the applications of deep learning in different fields. With the maturity and rising number of deep learning works in different fields, people have started writing survey papers to provide a review of the most promising works in those topics.

Table of Contents

1. Computer Vision Related Surveys
2. NLP Related Surveys
3. Healthcare Related Surveys
4. Other Areas Surveys

1. Computer Vision Related Surveys

Here we provide a list of surveys for deep learning applications in computer vision.

• Diffusion Models in Vision:
  • Diffusion models in vision: A survey (PAMI, 2023)
  • Text-to-image diffusion model in generative ai: A survey (arXiv, 2023)
  • Diffusion models: A comprehensive survey of methods and applications (ACM CSUR, 2023)
• Object Detection:
  • Deep Learning for Generic Object Detection: A Survey (IJCV, 2019)
  • Object Detection with Deep Learning: A Review (IEEE TNNLS, 2019)
  • A Survey of Deep Learning-Based Object Detection (IEEE Access, 2019)
  • Recent advances in deep learning for object detection (Neurocomputing, 2020)
• Image Segmentation:
  • Image Segmentation Using Deep Learning: A Survey (IEEE PAMI, 2021)
  • A survey on deep learning techniques for image and video semantic segmentation (Applied Soft Computing, 2018)
• Medical Image Segmentation:
  • Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges (Journal of Digital Imaging, 2018)
  • A review: Deep learning for medical image segmentation using multi-modality fusion (Elsevier Array, 2019)
  • Automatic breast ultrasound image segmentation: A survey (Pattern Recognition, 2018)
• Face Recognition:
  • Deep Face Recognition: A Survey (Arxiv, 2019)
  • Face recognition systems: A survey (Sensors, 2020)
• Biometrics Recognition:
  • Biometric Recognition Using Deep Learning: A Survey (AIRE, 2022)
  • Deep learning for biometrics: A survey (ACM CSUR, 2018)
• Image Super-Resolution:
  • Deep learning for image super-resolution: A survey (PAMI, 2020)
  • A deep journey into super-resolution: A survey (ACM CSUR, 2020)
• Facial Expression Recognition:
  • Deep facial expression recognition: A survey (Arxiv, 2019)
• Action Recognition:
  • Going deeper into action recognition: A survey (Image and vision computing, 2017)
  • Human action recognition and prediction: A survey (IJCV, 2022)
• GANs:
  • Generative Adversarial Networks: A Survey and Taxonomy (Arxiv, 2019)
  • Generative adversarial networks: A survey toward private and secure applications (ACM CSUR, 2021)
• Image Captioning:
  • A comprehensive survey of deep learning for image captioning (ACM Computing Surveys, 2019)
• Human Motion Recognition:
  • RGB-D-based human motion recognition with deep learning: A survey (Computer Vision and Image Understanding, 2018)
• Neural Rendering:
  • State of the Art on Neural Rendering (Computer Graphics Forum, 2020)

2. NLP Related Surveys

NLP tasks have seen a great progress over the past few years with the help of deep neural architectures, such as attentional LSTM, Transformer, BERT, GPT models, and XL-Net.

• Large Language Models:
  • Large language models: A survey (arXiv, 2024)
  • A survey of large language models (arXiv, 2023)
• Transformers:
  • A survey of transformers (AI Open, 2022)
  • Efficient transformers: A survey (ACM CSUR, 2022)
• General NLP:
  • Deep Learning Based Text Classification: A Comprehensive Review (ACM Computing Surveys, 2021)
  • Recent trends in deep learning based natural language processing (IEEE Computational intelligence magazine, 2018)
• Dialogue Systems, Conversational AI:
  • Neural approaches to conversational AI (Foundations and Trends® in Information Retrieval, 2019)
  • A survey of natural language generation techniques with a focus on dialogue systems-past, present and future directions (Arxiv, 2018)
  • A survey on dialogue systems: Recent advances and new frontiers (Acm Sigkdd Explorations Newsletter, 2017)
• Embedding:
  • Word embeddings: A survey (Arxiv, 2019)
  • Neural Information Retrieval: A Literature Review (Arxiv, 2016)
• Natural Language Generation:
  • Survey of the state of the art in natural language generation: Core tasks, applications and evaluation (Journal of Artificial Intelligence Research, 2018)
• Text Summarization:
  • Neural abstractive text summarization with sequence-to-sequence models (Arxiv, 2019)
• Sentiment Analysis:
  • Deep learning for sentiment analysis: A survey (Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 2018)
  • Deep learning for aspect-based sentiment analysis: a comparative review (Expert Systems with Applications, 2019)
  • A survey of sentiment analysis in social media(Knowledge and Information Systems, 2019)
• Named Entity Recognition:
  • A survey on recent advances in named entity recognition from deep learning models (Arxiv, 2019)
  • A survey on deep learning for named entity recognition (Arxiv, 2018)
• Answer Selection:
  • A review on deep learning techniques applied to answer selection (Proceedings of the 27th International Conference on Computational Linguistics, 2018)
• NLP based Financial Forecasting:
  
  • Natural language based financial forecasting: a survey (Artificial Intelligence Review, 2018)
    

3. Healthcare Related Surveys

Deep learning models

• Medical Image Analysis:
  • A survey on deep learning in medical image analysis (Medical image analysis, 2017)
• Health-Record Analysis:
  • Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis ( IEEE journal of biomedical and health informatics, published, 2017)
• Bioinformatics:
  • A survey of data mining and deep learning in bioinformatics (Journal of medical systems, 2018)
• Medical Imaging (MRI):
  • An overview of deep learning in medical imaging focusing on MRI (Zeitschrift für Medizinische Physik, 2019)
• Radiotherapy:
  • Survey on deep learning for radiotherapy (Computers in biology and medicine, 2018)
• Pharmacogenomics:
  • Deep learning in pharmacogenomics: from gene regulation to patient stratification (Future Medicine, 2019)
• Cancer Detection and Diagnosis:
  • Deep learning for image-based cancer detection and diagnosis− a survey (Pattern Recognition, 2018)
• Microscopy Image Analysis:
  • Deep learning in microscopy image analysis: A survey (EEE Transactions on Neural Networks and Learning Systems, 2017)
• Radialogy:
  • Deep learning in radiology: An overview of the concepts and a survey of the state of the art with focus on MRI (Journal of magnetic resonance imaging, 2019)
    

4. Other Areas Surveys

Deep learning models have been used in various other fields in recent years. Some of the most popular ones includes:

• Reinforcement Learning:
  • Deep reinforcement learning: An overview (Arxiv, 2017)
  • Deep reinforcement learning: A brief survey (IEEE Signal Processing Magazine, 2017)
• Recommender Systems:
  • Deep learning based recommender system: A survey and new perspectives (ACM Computing Surveys, 2019)
• Big Data:
  • A survey on deep learning for big data (Information Fusion, 2018)
• Networking:
  • Deep learning in mobile and wireless networking: A surve (IEEE Communications Surveys, 2019)
• IoT Big Data:
  • Deep learning for IoT big data and streaming analytics: A survey (Deep learning for IoT big data and streaming analytics: A survey., 2019)
• Anomly Detection:
  • A survey of deep learning-based network anomaly detection (Cluster Computing, 2017)
• Remote sensing:
  • Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community (Journal of Applied Remote Sensing, 2017)
• Mobile Multimedia:
  • Deep learning for mobile multimedia: A survey ( ACM Transactions on Multimedia Computing, Communications, and Applications, 2017)
• Graphs:
  • Deep learning on graphs: A survey (Arxiv, 2018)
  • Graph embedding techniques, applications, and performance: A survey (Knowledge-Based Systems, 2018)
• Multimodal Learning:
  • Deep multimodal learning: A survey on recent advances and trends (IEEE Signal Processing Magazine, 2017)
  • Deep multimodal representation learning: A survey (IEEE Access, 2019)
• Agriculture:
  • Deep learning in agriculture: A survey (Computers and electronics in agriculture, 2018)