BlinkDL/RWKV-LM

How does the generation speed of RWKV-5/6 compare to that of mamba with the same number of parameters?

h-zhao1997 opened this issue 2 months ago · 1 comments

h-zhao1997 commented 2 months ago

How does the generation speed of RWKV-5/6 compare to that of mamba with the same number of parameters?

BlinkDL commented 2 months ago

similar. try https://github.com/BlinkDL/ChatRWKV/blob/main/API_DEMO_CHAT.py