/Sequoia

scalable and robust tree-based speculative decoding algorithm

Primary LanguagePython

Stargazers