/Sentence-classification-via-Attention-mechanism

experiments on text classification using attention mechanism

Primary LanguageJupyter Notebook

Sentence-classification-via-Attention-mechanism

  • Data-sets used from Yoon-Kim's SOA CNN paper

  • considered table2. of Sentence classification via Attention mechanism(Yoon Kim) as baseline

  • Performed series of experiments using attention mechanism (contains Self-attention concept of Transformer model, NMT model by Bahadanau)

  • Words pretrained with Glove emebddingds - 840B, 300d

  • Testing: Run as 10-fold CV for every dataset