/GPT2-Chest-X-Ray-Report-Generation

This is the implementation of the CDGPT2 model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transformers'

Primary LanguagePython

GPT2-Chest-X-Ray-Report-Generation (CDGPT2)

This is the implementation of the CDGPT2 model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transformers'.

Paper link here.

We automatically generate full radiology reports given chest X-ray images from the IU-X-Ray dataset by conditioning a pre-trained GPT2 model on the visual and semantic features of the image.

Model checkpoint here. chest overall dpi

Sample Predictions

image

Installation & Usage

  • pip install -r requirements.txt
  • nlg-eval --setup
  • python train.py

Related Repositories

  • VSGRU repository here.
  • Finetuned Chexnet repository here.

Citation

To cite this paper, please use:

@article{ALFARGHALY2021100557,
title = {Automated radiology report generation using conditioned transformers},
journal = {Informatics in Medicine Unlocked},
volume = {24},
pages = {100557},
year = {2021},
issn = {2352-9148},
doi = {https://doi.org/10.1016/j.imu.2021.100557},
url = {https://www.sciencedirect.com/science/article/pii/S2352914821000472},
author = {Omar Alfarghaly and Rana Khaled and Abeer Elkorany and Maha Helal and Aly Fahmy}
}