/RouteLLM

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers