/Spec-Bench

Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers