response times out using the push to talk example
electronicsuk opened this issue · 0 comments
electronicsuk commented
running the push to talk example. It appears to working up until playing back the response.
I get a message DEBUG:root:ConverseResponse: audio_data (1600 bytes) then it freezes for about a minute or so then times out.
I have tested the sound configuration using aplay and arecord. They both work as expected. I am running this using a docker container running debian bullseye. The container is hosted by BalenaOs on a raspberry pi 1.2B. I have a fibre over copper internet connection so there's plenty of bandwidth.
Press Enter to send a new request...
INFO:root:Recording audio request.
DEBUG:root:ConverseRequest: config {
audio_in_config {
encoding: LINEAR16
sample_rate_hertz: 16000
}
audio_out_config {
encoding: LINEAR16
sample_rate_hertz: 16000
volume_percentage: 50
}
}
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
WARNING:root:SoundDeviceStream read overflow (3200, 6400)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseResponse:
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse: event_type: END_OF_UTTERANCE
INFO:root:End of audio request detected
DEBUG:root:ConverseResponse: result {
spoken_request_text: "what is the weather like"
}
INFO:root:Transcript of user request: "what is the weather like".
INFO:root:Playing assistant response.
DEBUG:root:ConverseResponse: result {
conversation_state: "\n,C#FOv2::65d288e6-0000-2991-9a3e-089e08285770\022\366\001Kj93OFRSMXhIcC1MMDhBQ0otYlpnTFg1NE43SzdkbXBodzRQNU15UkN0UXdJQUFJQ3pBTUx2bEJWVnVRQUFBQUE4qc-gpgZ6VwoUCAESEDAwMDAwMDY3YTMwNDY0MjgSP3c4VFIxeEhwLUwwOEFDSi1iWmdMWDU0TjdLN2RtcGh3NFA1TXlSQ3RRd0lBQUlDekFNTHZsQlZWdVFBQUFBQYoBFRITCO6PmfjxuYADFT3XAgcdOy0Lyw"
microphone_mode: CLOSE_MICROPHONE
}
DEBUG:root:ConverseRequest: audio_in (6400 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
DEBUG:root:ConverseResponse: audio_data (1600 bytes)
^TTraceback (most recent call last):
File "/env/bin/googlesamples-assistant-pushtotalk", line 8, in <module>
sys.exit(main())
File "/env/lib/python3.9/site-packages/click/core.py", line 722, in __call__
return self.main(*args, **kwargs)
File "/env/lib/python3.9/site-packages/click/core.py", line 697, in main
rv = self.invoke(ctx)
File "/env/lib/python3.9/site-packages/click/core.py", line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/env/lib/python3.9/site-packages/click/core.py", line 535, in invoke
return callback(*args, **kwargs)
File "/env/lib/python3.9/site-packages/googlesamples/assistant/grpc/pushtotalk.py", line 317, in main
continue_conversation = assistant.converse()
File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 289, in wrapped_f
return self(f, *args, **kw)
File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 379, in __call__
do = self.iter(retry_state=retry_state)
File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 314, in iter
return fut.result()
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
return self.__get_result()
File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
raise self._exception
File "/env/lib/python3.9/site-packages/tenacity/__init__.py", line 382, in __call__
result = fn(*args, **kwargs)
File "/env/lib/python3.9/site-packages/googlesamples/assistant/grpc/pushtotalk.py", line 109, in converse
for resp in self.assistant.Converse(iter_converse_requests(),
File "/env/lib/python3.9/site-packages/grpc/_channel.py", line 475, in __next__
return self._next()
File "/env/lib/python3.9/site-packages/grpc/_channel.py", line 864, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.DEADLINE_EXCEEDED
details = "Deadline Exceeded"
debug_error_string = "UNKNOWN:Error received from peer ipv4:142.250.179.234:443 {grpc_message:"Deadline Exceeded", grpc_status:4, created_time:"2023-07-31T21:32:13.336953588+00:00"}"