Dao-AILab/flash-attention

Do the headdim of q, k, and v must be the same？

zhanglonghao1992 opened this issue · 1 comments

zhanglonghao1992 commented

Do the headdim of q, k, and v must be the same？

tridao commented

Yes