In this code we will go how to implement transformer for audio classification. Although it is not that hard, we need to take a some consideration for the positional encoding You can check https://codeburst.io/how-to-use-transformer-for-audio-classification-5f4bc0d0c1f0?source=friends_link&sk=9fd73c211343c01868886eb8523b87bb
hsoony/transfomer-audio-classification
small experimentation about positional encoding
Jupyter Notebook