why does the program ignore the three layers?
znsoftm opened this issue · 2 comments
znsoftm commented
In the convertion script, it ignores embeddings.position_ids
if name in ['embeddings.position_ids', 'pooler.dense.weight', 'pooler.dense.bias']:
continue
why?
skeskinen commented
position_ids is just list of integers, 0,1,2,3...
We can just recreate that at startup
znsoftm commented
thanks:)