This project is used for our paper "Evaluating Generative Artificial Intelligence Against Radiologists on Impressions Generation in Radiology Reports.
- including_data.py is used to randomly select 300 reports.
- assign_task.py is used to assign tasks to the 5 evaluators.
- generate_impressions.py is the base code used to generate impressions according to the FINDINGS section in the reports.
- generate_impression_wenxinyiyan.py is the code used to generate impressions according to the FINDINGS section in the reports, and the impressions are generated by ERNIE 4.0.
- generate_impression_claude35sonnet20240620.py is the code used to generate impressions according to the FINDINGS section in the reports, and the impressions are generated by claude35sonnet20240620.
- statistical_analysis.py is used to perform statistical analysis and visualization for our paper.