Author
- Alexander Wolf
Last Commit Date
- 2/26/18
This notebook shows how you can easily train a neural translation model using the Tensor2Tensor API; There will also an additional to show how to use the T2T Library to train any of their models in the API
- All of these datasets are for translating to English or from English
- You can add additional datasets to the Tensor2Tensor library, and used their advanced NMT models supplied with the library
- French
- German
- Chinese
- Chzech
- Macedonian
- Benchmarking good translation models/accuracy is difficult due to the numerous of ways things can be translated
- The BLEU Score is the most commonly used and practical one
- I was able to Reach a BLEU score of 40 for English-> French and 33 for French-> English which is considered a state of the art performance
- Used the Transformer model from this research paper by google and model
- The Transformer architecture is precoded in the library = o
- Here is a photo of Tensorboard showing the training o an EN -> Fr model that reached a state of the art BLEU score of 40
- Training/Validation Loss Photo
- Show how to easily see results and decode in notebook
- Tensorboard tutorial for training on DSS gpu
- Detailed README
- Make T2T notebook