/outlines-mlx

A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX

Primary LanguagePythonApache License 2.0Apache-2.0

Not being maintained at the moment

  • Just FYI, this is a fork of an early mlx fork of outlines. Was mostly extending it to get it working for a specific use case and to see how much work was required to keep it updated (in short - a lot).
  • With mlx adding logprobs support, this type of stuff should be much easier to integrate in the future, either as a new standalone project or integrations into Outlines / mlx: ml-explore/mlx-examples#826 (reply in thread)