satani99/tinyformers

A concise but fully-featured transformer, complete with a set of promising experimental features from various papers implemented in tinygrad.

PythonMIT