In every epoch you get the weights/activations and turn hem into Numpy arrays. You can use a heatmap.
Remmelt12 opened this issue · 0 comments
Remmelt12 commented
In every epoch you get the weights/activations and turn hem into Numpy arrays. You can use a heatmap.
Originally posted by @benedekrozemberczki in #16 (comment)
Could you please provide more clarification on this? The activation weights are on the output of the convolutional pass. so they are vectors of length 32. How do you get a heatmap on the graph nodes from this? Sorry I am quite new to attention so I may not fully understand how to do this