xdxie/WordArt

About the experimental results

Closed this issue · 0 comments

When reproducing, it was found that cross attention did not benefit. The result of running directly is 64.2%, and when the cross attention is replaced with self-attention, the result is 64.7%. What is the reason for this, and I hope you can provide some suggestions?