luyuzhe111/Medusa
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Jupyter NotebookApache-2.0
Watchers
No one’s watching this repository yet.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Jupyter NotebookApache-2.0
No one’s watching this repository yet.