How to train the full-precision model?
liujingcs opened this issue · 1 comments
liujingcs commented
How to train the full-precision model? To train the full precision model, set the qw and qa to 32?
EowinYe commented
Actually, current codes do not support all full precision model (We try that by experimental codes). If you need to train the full precision model, you can make some modifications in codes.