/mlx-llm-server

For inferring and serving local LLMs using the MLX framework

Primary LanguagePython

Stargazers