/NLP-Beginner

Exercises of Natural Language Process.

Primary LanguagePython

NLP-Beginner

Exercises of Natural Language Process.

Acknowledgements

神经网络与深度学习

Task 1: Text categorization based on Softmax Regression

Language: Python

Tool: numpy

Feature extraction: Bag-of-word, N-gram

Data: Classify the sentiment of sentences from the Rotten Tomatoes dataset

Goal: Implement Softmax Regression to categorize different text into different sentiment.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 2: Text categorization based on RNN & CNN

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding, GloVe word embedding

Data: Classify the sentiment of sentences from the Rotten Tomatoes dataset

Goal: Implement Recursive Neural Network (RNN) and Convolution Neural Network (CNN) to categorize different text into different sentiment.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 3: Text matching based on attention

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding, GloVe word embedding

Data: The Stanford Natural Language Inference (SNLI)

Reference:Enhanced LSTM for Natural Language Inference

Goal: Implement ESIM mentioned in the reference above.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 4: Sequence Labeling based on LSTM+CRF

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding, GloVe word embedding

Data: CONLL 2003

Data Introduction: CONLL 2003

Reference:Neural Architectures for Named Entity Recognition

End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF

Goal: Sequence Labeling of CONLL 2003.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.

Task 5: Language Model based on Neural Network

Language: Python

Tool: pytorch, numpy

Feature extraction: Random word embedding

Data: poetryFromTang.txt

Reference:《神经网络与深度学习 chapter 6, 15

Goal: Generating poems.

  • All code has been uploaded

Please see my CSDN blog (in Chinese) for further illustration.