codelion/optillm

Implement routing

Closed this issue · 1 comments

Integrate https://github.com/lm-sys/RouteLLM to support routing between strong and weak models. We can also then enable routing between different approaches.

fixed in #62