Using gamma training (pr #4886) error
sashasubbbb opened this issue · 2 comments
sashasubbbb commented
All default settings error from the first step in HN gamma training
aria1th commented
It happens when inf or NaN value is encountered while training, can you try beta training instead? seems like there's issue with grad_scaler maybe...
Try updating Extension to the most recent version, and please check if issue remains
sashasubbbb commented
Fixed in latest update, thank you