Luodian/Otter

Implement flash attention/xformers support on Flamingo

Luodian opened this issue · 1 comments

Luodian commented

to support larger batchsize or more frames in video training data.

refere:

  1. https://github.com/HazyResearch/flash-attention
  2. https://github.com/facebookresearch/xformers