How to use FP32 in uni-core?
bearwithdog opened this issue · 1 comments
bearwithdog commented
I noticed the example : https://github.com/dptech-corp/Uni-Core/blob/main/examples/bert/train_bert_test.sh
How could i use fp32 ?
Just remove --fp16 --fp16-init-scale 4 --fp16-scale-window 256.
Thanks!
guolinke commented
yes, remove --fp16 (or --bf16)