sauradip/STALE

Better not use pytorch 1.8 + cuda 10.2

Closed this issue · 0 comments

Through my work, I found pytorch 1.8 + cuda 10.2 can lead to gradient explosion. I switched to pytorch 1.9 + cuda 11.1, then problem fixed.