openai/mle-bench

Missing Columns in Processed Data Compared to Official Sample Submission

WinstonLiyt opened this issue · 2 comments

Hello,

Thank you for the excellent work! I noticed that in the RANZCR CLiP - Catheter and Line Position Classification competition (id: ranzcr-clip-catheter-line-classification), the official sample submission includes the following columns:

StudyInstanceUID, ETT - Abnormal, ETT - Borderline, ETT - Normal, NGT - Abnormal, NGT - Borderline, 
NGT - Incompletely Imaged, NGT - Normal, CVC - Abnormal, CVC - Borderline, CVC - Normal, Swan Ganz Catheter Present

Image

However, after data processing, the generated submission file only retains:

StudyInstanceUID, ETT - Abnormal, ETT - Borderline, ETT - Normal, NGT - Abnormal, NGT - Borderline, 
NGT - Incompletely Imaged, NGT - Normal, CVC - Abnormal, CVC - Borderline

Image

I noticed that the "CVC - Normal" and "Swan Ganz Catheter Present" columns are missing from the processed data. Could you clarify the reason for this? Was this omission intentional, or could it be an oversight?

Looking forward to your response. Thanks again!

Best regards,
Yuante

Hi, thanks for flagging this! You are probably right. We will respond to this issue within the next 3 weeks (ideally sooner than that) (please bump this thread if we dont)