This is a pytorch implementation of Transformer [0] on one-dimensional data classification.
python test_synthetic.py to test on synthetic data
[0] Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information processing systems. 2017.