/quest-decoding

A package for sampling from Gibbs distributions during inference with LLMs.

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers