/cnn-lstm-bilstm-deepcnn-clstm-in-pytorch

In PyTorch Learing Neural Networks Likes CNN(Convolutional Neural Networks for Sentence Classification (Y.Kim, EMNLP 2014) 、LSTM、BiLSTM、DeepCNN 、CLSTM、CNN and LSTM

Primary LanguagePythonApache License 2.0Apache-2.0

Introduction

  • A classification task implement in pytorch, contains some neural networks in models.
  • Recenely, I've released the code.
    • old-version-17 release here
    • pytorch version == 0.3.1 release on here

Requirement

pyorch : 1.0.1
python : 3.6
torchtext: 0.2.1
cuda : 8.0 (support cuda speed up, can chose, default True)

Usage

modify the config file, see the Config directory(here) for detail.

1、python main.py
2、python main.py --config_file ./Config/config.cfg 
3、sh run.sh

Model

Contains some neural networks implement in pytorch, see the models for detail.

Data

SST-1 and SST-2.

Result

I haven't adjusted the hyper-parameters seriously, you can also see train log in here.

The following test set accuracy are based on the best dev set accuracy.

Data/Model % SST-1 % SST-2
CNN 46.1086 84.2943
Bi-LSTM 47.9186 86.3262
Bi-GRU 47.6923 86.7655

Reference

Question

  • if you have any question, you can open a issue or email bamtercelboo@{gmail.com, 163.com}.

  • if you have any good suggestions, you can PR or email me.