jadore801120/attention-is-all-you-need-pytorch

why PEpos+k can be represented as a linear function of PEpos?

myrainbowandsky opened this issue · 0 comments

In the original paper: section 3.5

PEpos+k can be represented as a linear function of PEpos.

How to prove that?