/LLMSpeculativeSampling

Fast inference from large lauguage models via speculative decoding

Primary LanguagePython

Stargazers

No one’s star this repository yet.