Update attention maps for flash attention and verify correctness
Opened this issue · 1 comments
iluise commented
when running with attention = True
the last match has the wrong values of latitude:
min and max values of the latitude for that particular batch:
batch 10 = 135.0 - 146.25
batch 11 = 148.5 - 159.75
batch 12 = 162.0 - 173.25
batch 13 = 166.75 - 178.0 --> this should be 173.5 - 184,75
clessig commented
The attention maps need to be updated due to the switch to flash attention. Then the above issue should be investigated as well.