RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!
Primary LanguageJupyter NotebookApache License 2.0Apache-2.0