Adriankhl/godot-llm

Text generation not running on macOS

Opened this issue · 0 comments

I am new to Godot and currently working on a video game for a competition. I want to implement an AI assistant using your fantastic addon. I downloaded the asset and a GGUF format file (gte-small.Q2_K.gguf). After running the model, nothing happens. I've waited 5+ minutes and the only output received is the prompt. (I monitor the generate_text_updated signal and print out the new text) I've also tried running this with the recommended model, but still nothing happens.