/smolrsrwkv

A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.

Primary LanguageRustMIT LicenseMIT

Watchers