CoLearn-Dev/fleece-benchmark

A benchmark framework for LLM serving performance, based on API call

Python