About Up Sweep
haikunzhang95 opened this issue · 1 comments
haikunzhang95 commented
How to understand the following actions? Which formulas does it correspond to in the paper?
Xa[:, :, :, 1].add_(Aa[:, :, :, 1].mul(Xa[:, :, :, 0]))
Aa[:, :, :, 1].mul_(Aa[:, :, :, 0])
Why multiply Aa[:, :, :, 1] before adding Xa[:, :, :, 0] to Xa[:, :, :, 1]?
Thank you.
alxndrTL commented
Hello, which paper are you talking about ? The Mamba paper doesn't go into the details of the pscan.
I have made a notebook explaining the pscan algorithm here : https://github.com/alxndrTL/mamba.py/blob/main/docs/pscan.ipynb
(it's not complete but should help you)