skeskinen/bert.cpp

why does the program ignore the three layers?

znsoftm opened this issue · 2 comments

In the convertion script, it ignores embeddings.position_ids

if name in ['embeddings.position_ids', 'pooler.dense.weight', 'pooler.dense.bias']:
    continue

why?

position_ids is just list of integers, 0,1,2,3...
We can just recreate that at startup

thanks:)