/speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

Primary LanguagePythonMIT LicenseMIT

Watchers