ShuoTang123/Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Jupyter NotebookApache-2.0
Stargazers
No one’s star this repository yet.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Jupyter NotebookApache-2.0
No one’s star this repository yet.