huggingface/local-gemma

Anyway to force json only output like we can in Llamacpp?

v3ss0n opened this issue · 1 comments

v3ss0n commented
Anyway to force json only output like we can in Llamacpp?
gante commented

@v3ss0n Not out of the box in local-gemma :)

However, this package will likely be of your interest: https://github.com/outlines-dev/outlines (built on top of transformers, can force formats like json)