Cannot run
Closed this issue · 3 comments
kwikiel commented
python demo/llm_chat.py
Traceback (most recent call last):
File "/Users/my_username/mlx-llm/mlx-llm/mlx-llm/demo/llm_chat.py", line 2, in
from mlx_llm.model import LLM
ModuleNotFoundError: No module named 'mlx_llm'
Steps to reproduce:
git clone https://github.com/riccardomusmeci/mlx-llm
cd mlx-llm
pip install .
Using Mac OS X 14.2.1 with Python 3.12
riccardomusmeci commented
Use python 3.10 versions. Let me know if it works fine.
hg7643 commented
try
from mlx_llm.model.llm import LLM
riccardomusmeci commented
@kwikiel did it work?