/benchmark_llm_serving

A library to benchmark LLMs via their API exposure

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

Watchers