hujiecpp/ISTR

About position embeddings

ding-Chen opened this issue · 1 comments

ding-Chen commented

I didn't understand how to position embedding got in this paper. I read this article in detail, but I didn't find the answer. Could you please introduce it? Thank you.

hujiecpp commented

I didn't understand how to position embedding got in this paper. I read this article in detail, but I didn't find the answer. Could you please introduce it? Thank you.

Hi @ding-Chen ,
You can treat the position embeddings as the randomly initialized learnable vectors.