reml-lab/mTAN

Not able to reproduce results for Physionet dataset

yalavarthivk opened this issue · 1 comments

yalavarthivk commented

Hi,

I have downloaded the code from the git repository and ran the mTAN classifier full on my local machine with the same hyperparameters mentioned. My results do not match with the published ones. In the paper, the mean ROC is 0.858 while I get 0.830.

I could not install torch==1.4.0, hence used torch---1.9. I am attaching the result for your reference.
physionet-cnn-0-569442.log

satyanshukla commented

I'm looking into the logs and checking the code, would be updating the code shortly to get the 0.858 ROC.