pltrdy/nlp_benchmarking

Shell

NLP Benchmarking

Comparing tools & techniques in NLP. Contributions are welcome!

Language Modeling

Pen Tree Bank (PTB) Benchmark: [go to benchmark]

Machine Translation

Automatic Text Summarization

Abstractive Text Summarization with Multi-Sentence I/O Using ONMT (+PyONMT): [go to benchmark]

Datasets

Gigaword [link] [MIT]
- From Rush et al, (2015)
- Used in:
  - Rush et al 2015
  - Chopra, Auli, Rush (2016)
  - Nallapati et al (2016)
CNN&Daily Mail Q&A+Stories (aka. DeepMind QA) [link] [Apache 2.0]
- From Hermann et al., NIPS 2015
- Used in:
- Repo: https://github.com/deepmind/rc-data