RWKV
RWKV is an RNN with Transformer-level LLM performance. It is hosted as an incubation project in LF AI & Data Foundation.
United States of America
Pinned Repositories
ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
ggml
Tensor library for machine learning
RWKV-cpp-node
Node.js implementation binding for the RWKV.cpp module
RWKV-infctx-trainer
RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
rwkv-onnx
A converter and basic tester for rwkv onnx
rwkv-tensorflow
RWKV ported to tensorflow
RWKV-tokenizer-node
RWKV tokenizer for node.js
RWKV-wiki
RWKV centralised docs for the community
rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
RWKV's Repositories
RWKV/rwkv.cpp
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
RWKV/RWKV-infctx-trainer
RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
RWKV/rwkv-onnx
A converter and basic tester for rwkv onnx
RWKV/RWKV-cpp-node
Node.js implementation binding for the RWKV.cpp module
RWKV/RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
RWKV/RWKV-wiki
RWKV centralised docs for the community
RWKV/rwkv-tensorflow
RWKV ported to tensorflow
RWKV/ChatRWKV
ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.
RWKV/RWKV-tokenizer-node
RWKV tokenizer for node.js
RWKV/ggml
Tensor library for machine learning
RWKV/llama.cpp
LLM inference in C/C++
RWKV/World-Tokenizer-Typescript
RWKV/artwork
Logos of RWKV projects
RWKV/lm-evaluation-harness
A framework for few-shot evaluation of language models.