llStringll/Transformer-model-encoder

Genrating vectors for tokens using bidirectional Attention towards contextual tokens from scratch

Python

Issues

(in unidirectional attention)Works for single example in data-set, as size of data-set goes greater than 1,network starts memorizing
#1 opened 6 years ago by llStringll
2