coder543/llm-speed-benchmark
A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API
PythonMIT
Issues
- 1
Add base_rul on client constructor
#1 opened by huberemanuel
A tool that can be used to measure the sequential performance of any OpenAI-compatible LLM API
PythonMIT