MCTS in Openweb ui
Opened this issue · 0 comments
bkev commented
Does your mcts code still work in Openweb ui or am I doing something wrong?
In Openweb ui I've gone to Admin Panel --> Functions (across the top) added and enabled it but nothing seems to happen?
Looking at Openweb ui Docker logs I see
"POST /api/v1/functions/id/mcts/toggle HTTP/1.1" 200 OK
INFO [open_webui.apps.ollama.main] get_all_models()
ERROR [open_webui.apps.webui.main] 'State' object has no attribute 'MODELS'
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/starlette/datastructures.py", line 699, in getattr
return self._state[key]
KeyError: 'MODELS'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/app/backend/open_webui/apps/webui/main.py", line 270, in get_pipe_models
sub_pipes = function_module.pipes()
^^^^^^^^^^^^^^^^^^^^^^^
File "<string>", line 374, in pipes
File "/usr/local/lib/python3.11/site-packages/starlette/datastructures.py", line 702, in __getattr__
raise AttributeError(message.format(self.__class__.__name__, key))
AttributeError: 'State' object has no attribute 'MODELS'
Openweb ui is running in Docker and Ollama on the host, but the models are working in Openweb ui so I don't believe it's a communication issue between Open web UI and Ollama.