imxcstar/CSharp-RWKV-V4

call rwkv v4 raven/world 1B5-14B onnx and ggml using csharp cpu/gpu (support INT4,8,Float16,32)

Support RWKV4 Raven 1B5-14B (onnx/ggml) (CPU/GPU)

Demo Download

Onnx Model Download

GGML Model Download | Download2

Model placement location

Preview

Reference Links

• RWKV Hugging Face repo: https://huggingface.co/BlinkDL/rwkv-4-raven
• Onnx: https://github.com/harrisonvanderbyl/rwkv-onnx
• GGML: https://github.com/saharNooby/rwkv.cpp
• RWKV: https://github.com/BlinkDL/RWKV-LM
• ChatRWKV: https://github.com/BlinkDL/ChatRWKV
• Tokenizer: https://github.com/Alex1911-Jiang/GPT-3-Encoder-Sharp