USC-Melady/Benchmarking_DL_MIMICIII

Preprocess is killed while trying to save data_all (get_99plus_features_raw.py)

Opened this issue · 0 comments

Hi all,

while running the preprocess.py the preprocess is always killed if it tries to save
"data_all" by np.save(os.path.join(HRDIR, 'DB_merged_%dhrs.npy' % hrs), data_all)
created by the method "collect_admissions_with_more_than_hrs(hrs)" defined in preprocessing/steps/get_99plus_features_raw.py.

After checking "data_all" I realized that it is a double-nested list with differing number of elements.
E.g.: Element data_all[0] has 345 elements. Each of its element is also a list with 142 elements. But data_all[1] has 168 elements of which each has 142 elements. Many of them are "None".

I am looking forward to hear from you. Thanks!