/Medical-Report-Generation-Papers

Paper List for ClinicalNLP 2023 paper "A Survey of Evaluation Methods of Generated Medical Textual Reports"

A Paper List for Medical Report Generation

This is a paper list for medical report generation, and more specifically for text-based MRG.

Keyword: Medical Report Generation, Natural Language Generation, NLG4Health

Paper List

Survey

  1. Text generation in clinical medicine--a review D Hüske-Kraus Methods Inf Med(2003) [pdf]
  2. A Survey on Medical Document Summarization Raghav Jain, Anubhav Jangra, Sriparna Saha, Adam Jatowt J. ACM 37, 4, Article 111 (August 2018) [pdf]
  3. MINIMAR (MINimum Information for Medical AI Reporting): Developing reporting standards for artificial intelligence in health care Tina Hernandez-Boussard, Selen Bozkurt, John P A Ioannidis, Nigam H Shah Journal of the American Medical Informatics Association (Dec 2020) [pdf]
  4. A Survey on Deep Learning and Explainability for Automatic Report Generation from Medical Images Pablo Messina, Pablo Pino, Denis Parra, Alvaro Soto, Cecilia Besa, Sergio Uribe, Marcelo Andía, Cristian Tejos, Claudia Prieto, and Daniel Capurro ACM Comput. Surv. (December 2021) [pdf]
  5. The digital scribe in clinical practice: a scoping review and research agenda Marieke M. van Buchem, Hileen Boosman, Martijn P. Bauer, Ilse M. J. Kant, Simone A. Cammel & Ewout W. Steyerberg npj Digital Medicine (March 2021) [pdf]
  6. A Survey on Dialogue Summarization: Recent Advances and New Frontiers Xiachong Feng, Xiaocheng Feng, Bing Qin IJCAI-22 [pdf]
  7. A Benchmark for Automatic Medical Consultation System: Frameworks, Tasks and Datasets Wei Chen, Zhiwei Li, Hongyi Fang, Qianyuan Yao, Cheng Zhong, Jianye Hao, Qi Zhang, Xuanjing Huang, Jiajie Peng, Zhongyu Wei arXiv (April 2022) [pdf]
  8. Prompt Engineering for Healthcare: Methodologies and Applications Jiaqi Wang, Enze Shi, Sigang Yu, Zihao Wu, Chong Ma, Haixing Dai, Qiushi Yang, Yanqing Kang, Jinru Wu, Huawen Hu, Chenxi Yue, Haiyang Zhang, Yiheng Liu, Xiang Li, Bao Ge, Dajiang Zhu, Yixuan Yuan, Dinggang Shen, Tianming Liu, Shu Zhang arXiv (April 2023) [pdf]

Evaluation

  1. Why We Need New Evaluation Metrics for NLG Jekaterina Novikova, Ondřej Dušek, Amanda Cercas Curry, Verena Rieser EMNLP 2017 [pdf]
  2. A Structured Review of the Validity of BLEU Ehud Reiter Computational Linguistics (2018) [pdf]
  3. Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions David M. Howcroft, Anya Belz, Miruna-Adriana Clinciu, Dimitra Gkatzia, Sadid A. Hasan, Saad Mahamood, Simon Mille, Emiel van Miltenburg, Sashank Santhanam, Verena Rieser INLG 2020 [pdf]
  4. Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation Aleksandar Savkov, Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Anya Belz, Ehud Reiter EMNLP 2022 [pdf]
  5. Are Experts Needed? On Human Evaluation of Counselling Reflection Generation Zixiu Wu, Simone Balloccu, Ehud Reiter, Rim Helaoui, Diego Reforgiato Recupero, Daniele Riboni ACL 2023 [pdf]

LLM Era

  1. shs-nlp at RadSum23: Domain-Adaptive Pre-training of Instruction-tuned LLMs for Radiology Report Impression Generation Sanjeev Kumar Karn, Rikhiya Ghosh, Kusuma P, Oladimeji Farri BioNLP 2023 [pdf]
  2. Generation of Radiology Findings in Chest X-Ray by Leveraging Collaborative Knowledge Manuela Daniela Danu, George Marica, Sanjeev Kumar Karn, Bogdan Georgescu, Awais Mansoor, Florin Ghesu, Lucian Mihai Itu, Constantin Suciu, Sasa Grbic, Oladimeji Farri, Dorin Comaniciu ITQM 2023 [pdf]
  3. Evaluating Large Language Models for Radiology Natural Language Processing Zhengliang Liu, Tianyang Zhong, Yiwei Li, Yutong Zhang, Yi Pan, Zihao Zhao, Peixin Dong, Chao Cao, Yuxiao Liu, Peng Shu, Yaonai Wei, Zihao Wu, Chong Ma, Jiaqi Wang, Sheng Wang, Mengyue Zhou, Zuowei Jiang, Chunlin Li, Jason Holmes, Shaochen Xu, Lu Zhang, Haixing Dai, Kai Zhang, Lin Zhao, Yuanhao Chen, Xu Liu, Peilong Wang, Pingkun Yan, Jun Liu, Bao Ge, Lichao Sun, Dajiang Zhu, Xiang Li, Wei Liu, Xiaoyan Cai, Xintao Hu, Xi Jiang, Shu Zhang, Xin Zhang, Tuo Zhang, Shijie Zhao, Quanzheng Li, Hongtu Zhu, Dinggang Shen, Tianming Liu arXiv (July 2023) [pdf]
  4. Radiology-Llama2: Best-in-Class Large Language Model for Radiology Zhengliang Liu, Yiwei Li, Peng Shu, Aoxiao Zhong, Longtao Yang, Chao Ju, Zihao Wu, Chong Ma, Jie Luo, Cheng Chen, Sekeun Kim, Jiang Hu, Haixing Dai, Lin Zhao, Dajiang Zhu, Jun Liu, Wei Liu, Dinggang Shen, Tianming Liu, Quanzheng Li, Xiang Li arXiv (Aug 2023) [pdf]
  5. Retrieving Evidence from EHRs with LLMs: Possibilities and Challenges Hiba Ahsan, Denis Jered McInerney, Jisoo Kim, Christopher Potter, Geoffrey Young, Silvio Amir, Byron C. Wallace arXiv (Sep 2023) [pdf]
  6. Large language models in medicine Arun James Thirunavukarasu, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan & Daniel Shu Wei Ting nature medicine (July 2023) [pdf]
  7. Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT models Mercy Ranjit, Gopinath Ganapathy, Ranjit Manuel, Tanuja Ganu arXiv (May 2023) [pdf]
  8. R2GenGPT: Radiology Report Generation with Frozen LLMs Zhanyu Wang, Lingqiao Liu, Lei Wang, Luping Zhou arXiv (Sep 2023) [pdf]
  9. BioSignal Copilot: Leveraging the power of LLMs in drafting reports for biomedical signals Chunyu Liu, Yongpei Ma, Kavitha Kothur, Armin Nikpour, Omid Kavehei medrxiv (July 2023) [pdf]
  10. LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation Suhyeon Lee, Won Jun Kim, Jinho Chang, Jong Chul Ye arXiv (May 2023) [pdf]
  11. Large language models in medicine: the potentials and pitfalls Jesutofunmi A. Omiye, Haiwen Gui, Shawheen J. Rezaei, James Zou, Roxana Daneshjou arXiv (Aug 2023) [pdf]
  12. Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts Dave Van Veen, Cara Van Uden, Louis Blankemeier, Jean-Benoit Delbrouck, Asad Aali, Christian Bluethgen, Anuj Pareek, Malgorzata Polacin, Eduardo Pontes Reis, Anna Seehofnerova, Nidhi Rohatgi, Poonam Hosamani, William Collins, Neera Ahuja, Curtis P. Langlotz, Jason Hom, Sergios Gatidis, John Pauly, Akshay S. Chaudhari arXiv (Sep 2023) [pdf]

Dataset

ID Name Description Paper Conference
1 Medical Conversation (ChiCCo) Medical conversation Summarizing Medical Conversations via Identifying Important Utterances COLING20
2 Automated Medical Transcription Medical, psychiatric consultations
3 MTSamples Medical Towards objectively evaluating the quality of generated medical summaries HumEval 2021
4 MEMO Mental health, Counseling Counseling Summarization Using Mental Health Knowledge Guided Utterance Filtering KDD 2022
5 PriMock57 Medical, Primary Care Mock Consultations PriMock57: A Dataset Of Primary Care Mock Consultations ACL 2022
6 MTS-Dialog Doctor-Patient Encounters An Empirical Study of Clinical Note Generation from Doctor-Patient Encounters EACL 2023
7 ACI-BENCH Visit Note Generation ACI-BENCH: a Novel Ambient Clinical Intelligence Dataset for Benchmarking Automatic Visit Note Generation Nature Scientific Data 2023

Text-to-text

Medical Dialogue Summarization

  1. Counseling Summarization using Mental Health Knowledge Guided Utterance Filtering Aseem Srivastava, Tharun Suresh, Sarah Peregrine (Grin)Lord, Md. Shad Akhtar, Tanmoy Chakraborty KDD 2022 ADS Track [pdf]
  2. Adding more data does not always help: A study in medical conversation summarization with PEGASUS Varun Nair, Namit Katariya, Xavier Amatriain, Ilya Valmianski, Anitha Kannan [pdf]
  3. Leveraging Pretrained Models for Automatic Summarization of Doctor-Patient Conversations Longxiang Zhang, Renato Negrinho, Arindam Ghosh, Vasudevan Jagannathan, Hamid Reza Hassanzadeh, Thomas Schaaf, and Matthew R. Gormley Findings of EMNLP 2021 [pdf]
  4. Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization Bharath Chintagunta, Namit Katariya, Xavier Amatriain, Anitha Kannan NAACL | NLPMC 2021 [pdf1] [pdf2]
  5. Generating SOAP Notes from Doctor-Patient Conversations Using Modular Summarization Techniques Kundan Krishna, Sopan Khosla, Jeffrey P. Bigham, Zachary C. Lipton ACL 2021 [pdf] [code]
  6. Summarizing Medical Conversations via Identifying Important Utterances Yan Song, Yuanhe Tian, Nan Wang, Fei Xia COLING 2020 [pdf] [code] [bib]
  7. Dr.Summarize: Global Summarization of Medical Dialogue by Exploiting Local Structures Anirudh Joshi, Namit Katariya, Xavier Amatriain, Anitha Kannan Findings of EMNLP 2020 [pdf] [bib]
  8. Medical Dialogue Summarization for Automated Reporting in Healthcare Sabine Molenaar, Lientje Maas, Verónica Burriel, Fabiano Dalpiaz,Sjaak Brinkkemper Advanced Information Systems Engineering Workshops 2020 [pdf] [bib]
  9. Generating Medical Reports from Patient-Doctor Conversations using Sequence-to-Sequence Models Seppo Enarvi, Marilisa Amoia, Miguel Del-Agua Teba, Brian Delaney, Frank Diehl, Stefan Hahn, Kristina Harris, Liam McGrath, Yue Pan, Joel Pinto, Luca Rubini, Miguel Ruiz, Gagandeep Singh, Fabian Stemmer, Weiyi Sun, Paul Vozila, Thomas Lin, Ranjani Ramamurthy ACL | NLPMC 2020 [pdf] [bib]
  10. Automatically Generating Psychiatric Case Notes From Digital Transcripts of Doctor-Patient Conversations Nazmul Kazi, Indika Kahanda NAACL 2019 [pdf] [bib]
  11. Alignment Annotation for Clinic Visit Dialogue to Clinical Note Sentence Language Generation Wen-wai Yim, Meliha Yetisgen, Jenny Huang, Micah Grossman LREC 2020 [pdf] [bib]
  12. Topic-aware Pointer-Generator Networks for Summarizing Spoken Conversations Zhengyuan Liu, Angela Ng, Sheldon Lee, Ai Ti Aw, Nancy F. Chen ASRU 2019 [pdf]
  13. Extracting relevant information from physician-patient dialogues for automated clinical note taking Serena Jeblee, Faiza Khan Khattak, Noah Crampton, Muhammad Mamdani, Frank Rudzicz EMNLP | Louhi | WS [pdf]
  14. Automatic analysis of medical dialogue in the home hemodialysis domain: structure induction and summarization Ronilda C Lacson, Regina Barzilay, William J Long J Biomed Inform (Oct 2006) [pdf]
  15. Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Damir Juric, Jack Flann, Ehud Reiter, Anya Belz, Aleksandar Savkov ACL 2022 [pdf]
  16. Towards Automating Medical Scribing : Clinic Visit Dialogue2Note Sentence Alignment and Snippet Summarization Wen-wai Yim, Meliha Yetisgen NAACL | NLPMC 2021 [pdf]

Summarization of Hospital Stays/Hospitalizations

  1. Generating summaries of hospitalizations: A new metric to assess the complexity of medical terms and their definitions Sabita Acharya, Barbara Di Eugenio, Andrew D. Boyd, Karen Dunn Lopez, Richard Cameron, Gail M Keenan INLG | WS 2016 [pdf]
  2. PatientNarr: Towards generating patient-centric summaries of hospital stays Barbara Di Eugenio, Andrew Boyd, Camillo Lugaresi, Abhinaya Balasubramanian, Gail Keenan, Mike Burton, Tamara Goncalves Rezende Macieira, Jianrong Li, Yves Lussier, Yves Lussier INLG | WS 2014 [pdf]

Medical Report Summarization

  1. Towards Objectively Evaluating the Quality of Generated Medical Summaries Francesco Moramarco, Damir Juric, Aleksandar Savkov, Ehud Reiter EACL | HumEval 2021 [pdf]
  2. Differentiable Multi-Agent Actor-Critic for Multi-Step Radiology Report Summarization Sanjeev Kumar Karn, Ning Liu, Hinrich Schuetze, Oladimeji Farri ACL 2022 [pdf]
  3. Optimizing the Factual Correctness of a Summary: A Study of Summarizing Radiology Reports Yuhao Zhang, Derek Merck, Emily Tsai, Christopher D. Manning, Curtis Langlotz ACL 2020 [pdf]
  4. Ontology-Aware Clinical Abstractive Summarization MacAvaney, Sean and Sotudeh, Sajad and Cohan, Arman and Goharian, Nazli and Talati, Ish and Filice, Ross W. SIGIR'19 [pdf]
  5. RadAdapt: Radiology Report Summarization via Lightweight Domain Adaptation of Large Language Models Dave Van Veen, Cara Van Uden, Maayane Attias, Anuj Pareek, Christian Bluethgen, Malgorzata Polacin, Wah Chiu, Jean-Benoit Delbrouck, Juan Manuel Zambrano Chaves, Curtis P. Langlotz, Akshay S. Chaudhari, John Pauly arXiv (May 2023) [pdf]
  6. ImpressionGPT: An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPT Chong Ma, Zihao Wu, Jiaqi Wang, Shaochen Xu, Yaonai Wei, Zhengliang Liu, Xi Jiang, Lei Guo, Xiaoyan Cai, Shu Zhang, Tuo Zhang, Dajiang Zhu, Dinggang Shen, Tianming Liu, Xiang Li arXiv (May 2023) [pdf]
  7. Leveraging Summary Guidance on Medical Report Summarization Yunqi Zhu, Xuebing Yang, Yuanyuan Wu, Wensheng Zhang IEEE Journal of Biomedical and Health Informatics (October 2023) [link]

Medical Question Summarization

  1. Intent-aware Prompt Learning for Medical Question Summarization Leilei Zhang, Junfei Liu 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) (December 2022) [link]

Data-to-text

Report Generation from Medical Images

  1. TBI-Doc: Generating Patient & Clinician Reports from Brain Imaging Data Pamela Jordan, Nancy Green, Chistopher Thomas, Susan Holm INLG | WS 2014 [pdf]
  2. Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation Yasuhide Miura, Yuhao Zhang, Emily Tsai, Curtis Langlotz, Dan Jurafsky NAACL 2021 [pdf]
  3. Cross-modal Memory Networks for Radiology Report Generation Zhihong Chen, Yaling Shen, Yan Song, Xiang Wan ACL | IJCNLP 2021 [pdf]
  4. Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation An Yan, Zexue He, Xing Lu, Jiang Du, Eric Chang, Amilcare Gentili, Julian McAuley, Chun-Nan Hsu EMNLP | Findings 2021 [pdf]
  5. Generating Radiology Reports via Memory-driven Transformer Zhihong Chen, Yan Song, Tsung-Hui Chang, Xiang Wan EMNLP 2020 [pdf]
  6. Learning to Generate Clinically Coherent Chest X-Ray Reports Justin Lovelace, Bobak Mortazavi EMNLP | Findings 2020 [pdf]

Clinical Data Summarization

  1. Suregen-2: a shell system for the generation of clinical documents Dirk Hüske-Kraus EACL 2003 [pdf]
  2. Automatic generation of textual summaries from neonatal intensive care data François Portet, Ehud Reiter, Albert Gatt, Jim Hunter, Somayajulu Sripada, Yvonne Freer, Cindy Sykes Artificial Intelligence (2009) [pdf]
  3. The Importance of Narrative and Other Lessons from an Evaluation of an NLG System that Summarises Clinical Data Ehud Reiter, Albert Gatt, François Portet, Marian van der Meulen INLG | WS 2008 [pdf]
  4. How to talk to strangers: Generating medical reports for first-time users Dimitra Gkatzia, Verena Rieser , Oliver Lemon 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) [pdf]

Automated Medical Reporting

  1. Automated Medical Reporting: From Multimodal Inputs to Medical Reports through Knowledge Graphs Lientje Maas, Adriaan Kisjes, Iman Hashemi, Floris Heijmans, Fabiano Dalpiaz, Sandra Van Dulmen and Sjaak Brinkkemper BIOSTEC 2021 [pdf]

Other Applications

  1. Lessons from a failure: Generating tailored smoking cessation letters Ehud Reiter, Roma Robertson, Liesl M. Osman Artificial Intelligence (March 2003) [link]

Multi-modal

  1. Experience and Evidence are the eyes of an excellent summarizer! Towards Knowledge Infused Multi-modal Clinical Conversation Summarization Abhisek Tiwari, Anisha Saha, Sriparna Saha, Pushpak Bhattacharyya, Minakshi Dhar CIKM 2023 [pdf]

Copyright

By Yongxin Zhou (yongxin.zhou@univ-grenoble-alpes.fr) from Université Grenoble Alpes. Welcome to open an issue or make a pull request!