clessig/atmorep

Update attention maps for flash attention and verify correctness

Opened this issue · 1 comments

when running with attention = True the last match has the wrong values of latitude:

min and max values of the latitude for that particular batch:

batch 10 = 135.0 - 146.25
batch 11 = 148.5  - 159.75
batch 12 = 162.0 - 173.25
batch 13 = 166.75 - 178.0 --> this should be 173.5 - 184,75 

The attention maps need to be updated due to the switch to flash attention. Then the above issue should be investigated as well.