/llm-speed-benchmark

A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API

Primary LanguagePythonMIT LicenseMIT

Issues