Audio Problem
Alessandrog72 opened this issue · 9 comments
I was able to install everything, especially with the help of Dave
now I am facing a difficulty. I can hear the voice of the Dialoloflow, but the system does not recognize the starting message "hello" or other commands given by voice. Dialog log keeps telling me that it doesn't understand me \ or it doesn't hear me.
I am attaching some info. Can you give me some advice.
_"dialogflow": {
"project": "ivr-xrrt",
"credentials": "/home/key.json",
"lang": "it",
"events": {
"welcome": "Ciao"
},
"noInputTimeout": "15000"
{"level":30,"time":1649067991046,"pid":24888,"hostname":"mitelgw","msg":"connected to sip on tcp/10.32.0.88:5060,udp/10.32.0.88:5060","v":1}
{"level":30,"time":1649067996802,"pid":24888,"hostname":"mitelgw","msg":"call connected, starting dialogflow agent ivr-xrrt using lang it","v":1}
{"level":30,"time":1649067996879,"pid":24888,"hostname":"mitelgw","msg":"res: undefined","v":1}
{"level":20,"time":1649067997359,"pid":24888,"hostname":"mitelgw","response_id":"7dd13ce1-9718-4b9f-8dff-f25c5ef99e7e-96b8a746","query_result":{"query_text":"","language_code":"it","speech_recognition_confidence":0,"action":"input.unknown","parameters":{},"all_required_params_present":true,"fulfillment_text":"Potresti essere più specifico?","fulfillment_messages":[{"platform":"PLATFORM_UNSPECIFIED","text":{"text":["Potresti essere più specifico?"]}}],"webhook_source":"","output_contexts":[{"name":"projects/ivr-xrrt/locations/us/agent/sessions/94fc4492-44a6-4fd6-9cdc-e9966ee997b9/contexts/system_counters","lifespan_count":1,"parameters":{"no-match":1,"no-input":0}}],"intent":{"name":"projects/ivr-xrrt/locations/us/agent/intents/a6a0f656-3613-4317-9c7c-486a2a0c0779","display_name":"Default Fallback Intent","webhook_state":"WEBHOOK_STATE_UNSPECIFIED","priority":0,"is_fallback":true,"ml_disabled":false,"end_interaction":false,"input_context_names":[],"events":[],"training_phrases":[],"action":"","output_contexts":[],"reset_contexts":false,"parameters":[],"messages":[],"default_response_platforms":[],"root_followup_intent_name":"","followup_intent_info":[]},"intent_detection_confidence":1,"sentiment_analysis_result":{"query_text_sentiment":{"score":0,"magnitude":0}},"knowledge_answers":{"answers":[]}},"alternative_query_results":[],"webhook_status":{"code":0,"message":""},"output_audio_config":{"audio_encoding":"OUTPUT_AUDIO_ENCODING_LINEAR_16","sample_rate_hertz":0,"synthesize_speech_config":{"speaking_rate":1,"pitch":0,"volume_gain_db":0,"effects_profile_id":["telephony-class-application"],"voice":{"name":"","ssml_gender":"SSML_VOICE_GENDER_UNSPECIFIED"}}},"msg":"received intent","v":1}
{"level":30,"time":1649067997480,"pid":24888,"hostname":"mitelgw","msg":"received audio file /tmp/94fc4492-44a6-4fd6-9cdc-e9966ee997b9_1.wav","v":1}
{"level":20,"time":1649068005918,"pid":24888,"hostname":"mitelgw","response_id":"","recognition_result":{"message_type":"END_OF_SINGLE_UTTERANCE","transcript":"","is_final":false,"confidence":0},"alternative_query_results":[],"webhook_status":{"code":0,"message":""},"msg":"received end_of_utterance","v":1}
{"level":20,"time":1649068005938,"pid":24888,"hostname":"mitelgw","response_id":"","query_result":{"query_text":"","language_code":"it","speech_recognition_confidence":0,"action":"","parameters":{},"all_required_params_present":false,"fulfillment_text":"","fulfillment_messages":[],"webhook_source":"","output_contexts":[],"intent":{"name":"","display_name":"","webhook_state":"WEBHOOK_STATE_UNSPECIFIED","priority":0,"is_fallback":false,"ml_disabled":false,"end_interaction":false,"input_context_names":[],"events":[],"training_phrases":[],"action":"","output_contexts":[],"reset_contexts":false,"parameters":[],"messages":[],"default_response_platforms":[],"root_followup_intent_name":"","followup_intent_info":[]},"intent_detection_confidence":0,"sentiment_analysis_result":{"query_text_sentiment":{"score":0,"magnitude":0}},"knowledge_answers":{"answers":[]}},"alternative_query_results":[],"webhook_status":{"code":0,"message":""},"msg":"received intent","v":1}_
Thanks Ale
Not sure if this will matter, but can you try it-IT for the language code
Hello Dave
for language i read this link
https://cloud.google.com/dialogflow/es/docs/reference/language
Now i try .
It could be that my version of freeswitch is
FreeSWITCH version: 1.10.5-release+git20200818T185121Z25569c1631~64bit
and not 1.8.X
Thanks Ale
No, version 1.10.5 is good, that is what I use
I change it with it-IT
but problem is always
considering that it seems that it does not send my voice commands, at least in the log I do not see them, it could be a sampling problem
{"level":30,"time":1649073122729,"pid":25753,"hostname":"mitelgw","msg":"connected to sip on tcp/10.32.0.88:5060,udp/10.32.0.88:5060","v":1}
{"level":30,"time":1649073140014,"pid":25753,"hostname":"mitelgw","msg":"connected to sip on tcp/10.32.0.88:5060,udp/10.32.0.88:5060","v":1}
{"level":30,"time":1649073147511,"pid":25753,"hostname":"mitelgw","msg":"call connected, starting dialogflow agent seclan-ivr-xrrt using lang it-IT","v":1}
{"level":30,"time":1649073147588,"pid":25753,"hostname":"mitelgw","msg":"res: undefined","v":1}
{"level":20,"time":1649073148167,"pid":25753,"hostname":"mitelgw","response_id":"538ea989-2fe8-4ad3-9e96-5a441fd81047-96b8a746","query_result":{"query_text":"","language_code":"it","speech_recognition_confidence":0,"action":"input.unknown","parameters":{},"all_required_params_present":true,"fulfillment_text":"Non ho capito bene. Potresti ripetere?","fulfillment_messages":[{"platform":"PLATFORM_UNSPECIFIED","text":{"text":["Non ho capito bene. Potresti ripetere?"]}}],"webhook_source":"","output_contexts":[{"name":"projects/seclan-ivr-xrrt/locations/us/agent/sessions/aa6256f9-857e-46ce-9d84-aa794abba645/contexts/system_counters","lifespan_count":1,"parameters":{"no-input":0,"no-match":1}}],"intent":{"name":"projects/seclan-ivr-xrrt/locations/us/agent/intents/a6a0f656-3613-4317-9c7c-486a2a0c0779","display_name":"Default Fallback Intent","webhook_state":"WEBHOOK_STATE_UNSPECIFIED","priority":0,"is_fallback":true,"ml_disabled":false,"end_interaction":false,"input_context_names":[],"events":[],"training_phrases":[],"action":"","output_contexts":[],"reset_contexts":false,"parameters":[],"messages":[],"default_response_platforms":[],"root_followup_intent_name":"","followup_intent_info":[]},"intent_detection_confidence":1,"sentiment_analysis_result":{"query_text_sentiment":{"score":0,"magnitude":0}},"knowledge_answers":{"answers":[]}},"alternative_query_results":[],"webhook_status":{"code":0,"message":""},"output_audio_config":{"audio_encoding":"OUTPUT_AUDIO_ENCODING_LINEAR_16","sample_rate_hertz":0,"synthesize_speech_config":{"speaking_rate":1,"pitch":0,"volume_gain_db":0,"effects_profile_id":["telephony-class-application"],"voice":{"name":"","ssml_gender":"SSML_VOICE_GENDER_UNSPECIFIED"}}},"msg":"received intent","v":1}
{"level":30,"time":1649073148207,"pid":25753,"hostname":"mitelgw","msg":"received audio file /tmp/aa6256f9-857e-46ce-9d84-aa794abba645_1.wav","v":1}
{"level":20,"time":1649073156718,"pid":25753,"hostname":"mitelgw","response_id":"","recognition_result":{"message_type":"END_OF_SINGLE_UTTERANCE","transcript":"","is_final":false,"confidence":0},"alternative_query_results":[],"webhook_status":{"code":0,"message":""},"msg":"received end_of_utterance","v":1}
I have a news, for a few minutes yesterday the system worked correctly. When I spoke, the transcript was reported in the mod_dialogflow log. After that it stopped working and did not resume.
Can you give me some advice.
Thanks Ale
I would suggest getting a pcap trace that will include the sip and rtp. I suspect that for some reason when you are not hearing if you may not be receiving rtp for some reason
you can see in that trace that we are not receiving any RTP packets from the calling side. We send them back, but do not receive any. if you open the trace in wireshark and look at it with this filter it will become clear
sip or (udp.port == 24928 or udp.port == 29638)
There is some device/gateway at ip 10.32.0.82 that is sending the calls in to your server at 10.32.0.8.
What is the device that is at 10.32.0.82?
Your server that is running at 10.32.0.8 appears to have a public IP of 217.59.17.226. You have configured freeswitch to send RTP from this public address, so in our 200 OK to the calling side we are telling them to send audio to 217.59.17.226:29638.
Are you certain you are allowing this traffic in to the public ip and the freeswitch port ranges?
Did you mean to bind freeswitch to the public address?
going to close this one unless there is something further to report