Why Remove PreNorm?
Closed this issue · 0 comments
tonyyunyang commented
May I ask why the PreNorm is removed? I am very curious about the reason.
As the Transformer encoder is different from the architecture as shown below, which is from the original paper.
