Very basic Transformer encoder and decoder built with NumPy
Python
Transfomer
This project is a transformer built with Numpy from scratch following a tutorial, with the basic encoder and decoder structure from the paper "Attention is All You Need".
Feel free to provide any suggestions to the code, just started learning nlp