Unable to Train ERM model with civilcomments

Question

Unable to Train ERM model with civilcomments

Bluepossibility opened this issue 2 years ago · 3 comments

Hi,

I am having trouble in running the code with command
python3 wilds/examples/run_expt.py --dataset civilcomments --algorithm ERM --root_dir data --download
Everything stuck, no error reported, both GPU and CPU are not leveraged.

If ctrl+C, it shows

The same thing didn't happen when I tried to run the same script but with groupDRO.

It would be very helpful if you have any clue on this, and thank you a lot for your amazing, well developed code!

Answer 1 · 2022-12-08T06:56:56.000Z

Sorry, but we haven't encountered this error before. The groupDRO code is very similar to the ERM code, so if the former is working, I think it might not be anything specific to ERM that's causing the issue.

Answer 2 · 2022-12-08T06:57:12.000Z

(The same command works on our end.)

Answer 3 · 2022-12-08T20:33:33.000Z

Thanks, the erm model runs just fine when we tried to run the command on another VM, still not sure what's the reason why the previous one not working though. Thank you a lot for your time and help anyway!