susiwen8/tf-keras-attention-layer

attention_layer_tf_keras

This Layer is inspired by tensorflow/official/model/model/attention_layer.py

I try to rewrite it as a tf.keras layer

Original paper is Attention is all you need