Move the logit processors to `outlines-core`

Question

Move the logit processors to `outlines-core`

rlouf opened this issue 4 months ago · 3 comments

rlouf commented 4 months ago

Related to dottxt-ai/outlines-core#74

Answer 1 · 2024-10-12T08:05:03.000Z

It seems that this repo has been removed?

https://github.com/dottxt-ai/outlines-core

Answer 2 · 2024-10-12T08:54:42.000Z

It hasn't been opened (yet).

Answer 3 · 2024-10-24T13:32:18.000Z

After consideration, we will not be moving logit processors to outlines-core. The rationale is that we do not want to expose an interface whose implementation details depend on the internals of other libraries. Instead we will document best practices to avoid unnecessarily slow logit masking.