sirmarcel/cmlkit

Undefined behaviour in Dataset when filename is specified but not name

sxie22 opened this issue · 1 comments

When a Dataset is created with no name but saved with a filename, references to that filename are ignored by certain other Components like tune.Run using a tune.TuneEvaluatorHoldout that was initialized with filenames for the train/test kwargs. Interestingly, EvaluatorHoldout.evaluate() does not suffer, while Run.run() does.

Thanks! I think the reason that it shows up in Run is that on instantiation of the workers, it attempts to load the dataset by name (not filename), so it fails then.

I'll fix this by removing the filename option entirely! :D