jianzhnie/LLamaTuner

Would you support RWKV?

xiaol opened this issue · 1 comments

xiaol commented

as you see , RWKV world transformer version is here,
https://github.com/xiaol/Huggingface-RWKV-World/tree/main

and some refs:
https://osk6ppi3hr.feishu.cn/docx/ZlqkdTHD7owXpFxXvMyct0Jrn1d

RWKV is far beyond efficiency and you can use RWKV runner as a good reference.
https://github.com/josStorer/RWKV-Runner

RWKV model is on planing