Add Attention to the classification models
TharinduDR opened this issue · 6 comments
Thank you for the wonderful repo and tutorials.
Do you have an implementation to add attention to the classification models with torchtext?
If you know of any papers/models that have an attention based model for sequence classification, let me know and I can look into adding those. Usually attention is used for sequence-to-sequence learning, and I have some tutorials on that which use attention, see: https://github.com/bentrevett/pytorch-seq2seq tutorials 3 onwards.
That model is for sequence-to-sequence learning, not sequence classification.
Hi @bentrevett
Was just checking on the issue - people have used it for many Kaggle competitions commonly. One such example is this - https://www.kaggle.com/hung96ad/pytorch-starter
Thanks for the link. Will check it out.
i want to work on this issue, is it still open?