supershaneski/openai-whisper-talk

Voice not working

datacrud8 opened this issue · 2 comments

datacrud8 commented

Thank you for sharing this project.
I'm trying to run this local but TEXT message working with all functionality but VOICE totally not working. Is this expected behavior of this application ?

function_call.js working with tools_call but transcribe.js totally not handling this below, so its failed in "interface ChatCompletionMessage {"
tools: [
{ type: 'function', function: add_calendar_entry },
{ type: 'function', function: get_calendar_entry },
{ type: 'function', function: edit_calendar_entry },
{ type: 'function', function: delete_calendar_entry },
{ type: 'function', function: save_new_memory },
{ type: 'function', function: get_info_from_memory }
]

Can you please share the working transcribe.js file ? or how to fix this issue.
help is much appreciated. thank you.

supershaneski commented

I just tested it. I cloned the project, setup the .env file with proper values and run at localhost. If you run using an IP address, you need to run it using HTTPS otherwise you will not be able to record audio from the client.

datacrud8 commented

Mongodb installed correctly and its working with text input and saving the calendar and memory. But voice not working with this.
Yes I am using HTTPS only and audio recorded successfully and inside the flow its calling the function_call that time its failed with tools-call error since its not calling the above mentioned function. If possible please check with HTTPS .