riccardomusmeci/mlx-llm

Cannot run

Closed this issue · 3 comments

python demo/llm_chat.py
Traceback (most recent call last):
File "/Users/my_username/mlx-llm/mlx-llm/mlx-llm/demo/llm_chat.py", line 2, in
from mlx_llm.model import LLM
ModuleNotFoundError: No module named 'mlx_llm'

Steps to reproduce:
git clone https://github.com/riccardomusmeci/mlx-llm
cd mlx-llm
pip install .

Using Mac OS X 14.2.1 with Python 3.12

Use python 3.10 versions. Let me know if it works fine.

hg7643 commented

try

from mlx_llm.model.llm import LLM

@kwikiel did it work?