Mobile-Artificial-Intelligence/maid

App gets soft locked when there's issues reaching API server

PylotLight opened this issue · 8 comments

PylotLight commented

I've been using Maid as a frontend for my own custom AI server, but if you happen to submit a call that fails or can't reach the server the whole app gets frozen and the red stop button doesn't work/do anything.

Ideally the app times out quickly and returns an error.

danemadsen commented

Is this with Ollama i assume? The red stop button should only be present for llama.cpp

PylotLight commented

Is this with Ollama i assume? The red stop button should only be present for llama.cpp

Nope openAI