Access attention weights

[prasad4fun]

Hi @mandarjoshi90 ,

Thanks for your work. I am trying to visualize Spanbert base attention weights. when I read through the code couldn't find any param to get them.

Could you help me getting attention weights across 12 layers?