Question about space complexity
nihaomiao opened this issue · 1 comments
nihaomiao commented
Thanks very much for your interesting work! I have a question about the O(N) space complexity mentioned in your paper. I am wondering whether you can help me to figure it out.
In Eq. (11) of your paper, you compute QK^T in the denominator, which may lead to O(N^2*d) space complexity?
bests
nihaomiao commented
Leave my comment to official repository. Close this issue.