tsingcoo/self-speculative-decoding
Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
Jupyter NotebookApache-2.0
Stargazers
No one’s star this repository yet.
Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**
Jupyter NotebookApache-2.0
No one’s star this repository yet.