roberta中cls token的计算方法
wikithink opened this issue · 3 comments
wikithink commented
roberta取消了NSP任务，按道理模型输出应该没有cls的token的向量了，那么cls从哪里计算获取的？计算方法是什么？谢谢
ymcui commented
[CLS]就是第0位的表示啊
stale commented
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
stale commented
Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.