in the transformer part, is there any Pytorch API to Transformer Encoder?

Question

in the transformer part, is there any Pytorch API to Transformer Encoder?

Closed this issue 3 years ago · 1 comments

Hi Dude , good afternoon.
I'm reading your code. To my understanding , Transformer.py is for define the transformer encoder.
I'm wondering whether there is any API that we can use directly instead of tedious coding.

I just found torch.nn.TransformerEncoder exists. Is it usable in this project? Have you ever thought about this problem before?

Many thanks!

Answer 1 · 2021-04-28T09:48:53.000Z

Thanks for your questions, bro. As for API that we can use directly instead of tedious coding, I recommend timm for you. It's very convenient and useful. You can check for it for more details.Hope it would help you. If there is no more questions, you can close this issue.