Using ordinary split as an unlabeled split?

[yoonholee]

Is there a clean way to use an ordinary split as an unlabeled split by just dropping the labels?
For example, I'd like to be able to use --unlabeled_split val.

[kohpangwei]

Hmm, good question! I don't think the code supports it right now, but hopefully it shouldn't be a large change (you might need to add a conditional here: https://github.com/p-lambda/wilds/blob/main/examples/run_expt.py#L241 to check whether to retrieve the full unlabeled dataset or the full labeled dataset). If you end up supporting this, please let us know and we'd be happy to review a PR!

[yoonholee]

That makes sense. Thanks!