problem:11/20 10:40:54 AM: Weights from pretrained model not used in BertForPairCls: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias']
star-rui opened this issue · 1 comments
在运行get_new_dev_list.py时,控制台输出日志显示:
11/20 10:40:53 AM: loading file E:/project/StAR_KGC-master/StAR_KGC-master/bert-base-uncased/bert-base-uncased-vocab.txt
11/20 10:40:53 AM: loading weights file E:/project/StAR_KGC-master/StAR_KGC-master/bert-base-uncased/bert-base-uncased-pytorch_model.bin
11/20 10:40:54 AM: Weights of BertForPairCls not initialized from pretrained model: ['proj.weight', 'proj.bias']
11/20 10:40:54 AM: Weights from pretrained model not used in BertForPairCls: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias']
权重没有被加载,请问这是正常的吗?
This is normal and will not affect the results.