openai/openai-realtime-api-beta

Assistant hears themselves when speaking - Any tips?

Opened this issue · 1 comments

Not sure if this is something I need to implement in my code, or an audio equipment issue.

This happens during server_vad mode.
When the assistant is chatting with me, it will hear it's own voice through my speakers and then automatically pipe that into the next input.

Obviously, we could implement client side VAD (push to talk). Or when in server_vad mode, I could automatically pause my microphone while the assitant is responding, however this makes it hard for people to interrupt the assistant when they are talking.

Or should I just try to separate my microphone and speakers with different equipment.

Has anyone else run into a similar issue?

yeah, same issue i am facing