learnable position embedding
kun-dragon opened this issue · 1 comments
kun-dragon commented
Do you try to use learnable position embedding, instead of sinusoid encoding? Will it have better performance?
yztongzhan commented
We follow MAE and use sinusoid encoding as default setting.