Thread

[sam43b]

hi,

thank you so much for this wonderful framework,however, i get this error message , i'm using many ggml with pyllamacpp , i have AMD Ryzen 7 3700X 8-Core , and 32Go of ram

Text generation requested by client: bl_dcSQi6UQTKzyNAAAB
Received message : Write an email to my boss letting them know I am leaving the company.
Started generation task
warmup for generating 1716 tokens
Client bl_dcSQi6UQTKzyNAAAB disconnected
'bl_dcSQi6UQTKzyNAAAB'

Finished executing the generation

Done Generation

Exception in thread Thread-92 (start_message_generation):
Traceback (most recent call last):
File "/home/sam/appz/llm/vnv/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/home/sam/appz/llm/vnv/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/home/sam/appz/llm/lollms-webui/api/init.py", line 946, in start_message_generation
self.current_discussion.update_message(self.current_ai_message_id, self.connections[client_id]["generated_text"].strip())
KeyError: 'bl_dcSQi6UQTKzyNAAAB'
Client syJfYZAgBSmDEWNKAAAD connected

[ParisNeo]

Looks like something happened that caused the front end to disconnect.
Zre you using it remotely ?

[sam43b]

yes , i'm using it remotely on linux ubuntu 20.04 , but in the same network

[Nha-Krul]

Hi Parisneo.
I'm having the same issue. And the disconnections are more frequents if I use a reverse proxy.
Today I get this exception, maybe it helps.

Exception in thread Thread-72 (_thread):
Traceback (most recent call last):
Client euHA3MuNS--XMw9mAAAI disconnected
File "/usr/lib/python3.10/threading.py", line 1016, in _bootstrap_inner
self.run()
File "/usr/lib/python3.10/threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "/home/marcelo/software/lollms-webui/env/lib/python3.10/site-packages/simple_websocket/ws.py", line 169, in _thread
Client 5xkgVElOTZI34ppDAAAL connected
self.connected = self._handle_events()
File "/home/marcelo/software/lollms-webui/env/lib/python3.10/site-packages/simple_websocket/ws.py", line 249, in _handle_events
self.sock.send(out_data)
BrokenPipeError: [Errno 32] Broken pipe