预训练阶段的loss问题
rtygbwwwerr opened this issue · 2 comments
rtygbwwwerr commented
您好，想请问下，你们的BERT-wwm-ext模型及RoBERTa-wwm-ext模型预训练达到收敛的时候，预训练目标mlm及nsp的loss和acc大概是什么水平？
stale commented
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
stale commented
Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.