/vidur

A large-scale simulation framework for LLM inference

Primary LanguagePythonMIT LicenseMIT

Stargazers