anarchy-ai/llm-speed-benchmark

question

Opened this issue · 0 comments

geraldstanje1 commented

Hi,

does this also run on aws sagemaker? How to run it with TGI, VLLM, TensorRT-LLM etc?

Thanks,
Gerald