RWKV

RWKV is an RNN with Transformer-level LLM performance. It is hosted as an incubation project in LF AI & Data Foundation.

United States of America

Pinned Repositories

ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
Language:Python8 1 01
ggml
Tensor library for machine learning
Language:C3 0 01
RWKV-cpp-node
Node.js implementation binding for the RWKV.cpp module
Language:JavaScript20 2 34
RWKV-infctx-trainer
RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
Language:Jupyter Notebook133 5 2328
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Language:Python21 0 03
rwkv-onnx
A converter and basic tester for rwkv onnx
Language:Python42 3 83
rwkv-tensorflow
RWKV ported to tensorflow
Language:Python11 2 11
RWKV-tokenizer-node
RWKV tokenizer for node.js
Language:JavaScript4 2 13
RWKV-wiki
RWKV centralised docs for the community
19 2 36
rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Language:C++1.4k 22 8199

RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Language:C++1.4k 22 8199
RWKV/RWKV-infctx-trainer
RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
Language:Jupyter Notebook133 5 2328
RWKV/rwkv-onnx
A converter and basic tester for rwkv onnx
Language:Python42 3 83
RWKV/RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
Language:Python21 0 03
RWKV/RWKV-cpp-node
Node.js implementation binding for the RWKV.cpp module
Language:JavaScript20 2 34
RWKV/RWKV-wiki
RWKV centralised docs for the community
19 2 36
RWKV/rwkv-tensorflow
RWKV ported to tensorflow
Language:Python11 2 11
RWKV/ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
Language:Python8 1 01
RWKV/RWKV-tokenizer-node
RWKV tokenizer for node.js
Language:JavaScript4 2 13
RWKV/ggml
Tensor library for machine learning
Language:C3 0 01
RWKV/llama.cpp
LLM inference in C/C++
Language:C++2 1 0
RWKV/World-Tokenizer-Typescript
Language:TypeScript2 1 02
RWKV/artwork
Logos of RWKV projects
1 2 00
RWKV/lm-evaluation-harness
A framework for few-shot evaluation of language models.
Language:Python1 0 12