av/harbor

MCTS in Openweb ui

Opened this issue · 0 comments

bkev commented

Does your mcts code still work in Openweb ui or am I doing something wrong?

In Openweb ui I've gone to Admin Panel --> Functions (across the top) added and enabled it but nothing seems to happen?

Looking at Openweb ui Docker logs I see

"POST /api/v1/functions/id/mcts/toggle HTTP/1.1" 200 OK

INFO [open_webui.apps.ollama.main] get_all_models()

ERROR [open_webui.apps.webui.main] 'State' object has no attribute 'MODELS'

Traceback (most recent call last):

File "/usr/local/lib/python3.11/site-packages/starlette/datastructures.py", line 699, in getattr

return self._state[key]


KeyError: 'MODELS'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "/app/backend/open_webui/apps/webui/main.py", line 270, in get_pipe_models

sub_pipes = function_module.pipes()

^^^^^^^^^^^^^^^^^^^^^^^

File "<string>", line 374, in pipes

File "/usr/local/lib/python3.11/site-packages/starlette/datastructures.py", line 702, in __getattr__

raise AttributeError(message.format(self.__class__.__name__, key))

AttributeError: 'State' object has no attribute 'MODELS'

Openweb ui is running in Docker and Ollama on the host, but the models are working in Openweb ui so I don't believe it's a communication issue between Open web UI and Ollama.