/tinyformers

A concise but fully-featured transformer, complete with a set of promising experimental features from various papers implemented in tinygrad.

Primary LanguagePythonMIT LicenseMIT

No issues in this repository yet.