latitude-dev/latitude-llm

Refactor refiner to not use the gateway

Opened this issue · 0 comments

cesr commented

The goal of this task is to reimplement the refiner to not use the gateway. We want to offer a non-gateway product to our users, so we need to make sure we're dogfooding our own product to spot any bugs or ux improvements. Additionally, our LLM features on the OSS shouldn't go through our gateway.

Add any tasks/epics that are a dependency here.