How to add support for hindi language

Question

How to add support for hindi language

iamjamilkhan opened this issue 9 months ago · 14 comments

Hey xttsv2 officially support hindi but not alltalktts is there any way to make it support hindi as well ?

Answer 1 · 2024-04-18T19:11:14.000Z

I didn't see any official listing for Hindi https://docs.coqui.ai/en/latest/models/xtts.html#languages and Coqui have made no official listing of Hindi that I can find.

I have however hunted a bit further, I can see it mentioned here https://huggingface.co/coqui/XTTS-v2

It looks like Hindi is a late & undocumented addition to the XTTSv2 2.0.3 model (AllTalk as standard downloads the 2.0.2 model, which doesn't have Hindi Support).

So, I have added Hindi in the relevant places throughout AllTalk and tested with the 2.0.3 model. There are problems however, Coqui have not updated all their scripts to support Hindi (based on my testing).

The XTTS Local method will not work with Hindi. As such, if you want to use Hindi to generate TTS, you would have to:

Download the XTTS v2.0.3 model over the top of the v2.0.2 model. https://huggingface.co/coqui/XTTS-v2/tree/v2.0.3 (all files)
When AllTalk has loaded you would have to switch the endpoint to use API TTS or set it in the settings area:

curl -X POST "http://127.0.0.1:7851/api/reload?tts_method=API%20TTS"

restart required on changing the setting here

I have no idea what limitations or issues there are or could be with Hindi support. I've done my best to set AllTalk to pass Devanagari script, but again, I have no idea what Coqui's scripts are/aren't doing with this.

You are welcome to update and give it a try, but please note the above requirements and limitations.

Thanks

Answer 2 · 2024-04-19T05:21:54.000Z

Thanks for a quick update brother i have downloaded 2.03 model and palaced in model folder however while starting app its automatically select the version 2.02 is there any way to change Path of folder

Answer 3 · 2024-04-19T08:58:22.000Z

Hi @iamjamilkhan

The only reason its saying that its loading the 2.0.2 model is because its stored as the internal name within AllTalk, rather than any setting its pulling from the model. If you need to change it for purposes of being tidy, you would edit modeldownload.json and change the internal name there, specifically the model_path folder:

and you would re-name the folder in /models/ to match the name you are giving it:

When AllTalk loads, it will report the name stored by model_path

Thanks

Answer 4 · 2024-04-19T09:45:51.000Z

After changing path to new folder it’s won’t start and encountering a error should i reinstall alltalktts with new model path ?

Answer 5 · 2024-04-19T10:30:26.000Z

Okay its worked after reinstalling it but still there is no hindi option to choose is there I’m missing any steps ?

Answer 6 · 2024-04-19T10:32:30.000Z

iamjamilkhan commented 9 months ago

Answer 7 · 2024-04-19T10:42:40.000Z

I have tried with default English input it’s converting tts but acent is still English is there any way to change language or select hindi maybe its work perfectly. I have tried with xttsv2 officials hugging demo its works without any issue

Answer 8 · 2024-04-19T10:44:36.000Z

iamjamilkhan commented 9 months ago

Answer 9 · 2024-04-19T23:24:48.000Z

Hi @iamjamilkhan

Did you update AllTalk with a git pull? https://github.com/erew123/alltalk_tts?tab=readme-ov-file#-updating

Answer 10 · 2024-04-20T02:23:32.000Z

Ohh i have installed using zip let’s me reinstall it

Answer 11 · 2024-04-20T03:38:15.000Z

After updating to latest version the hindi option appear but its won’t generating anything even with another language i have tried with all model api local,local xtts and api tts seem sometimes broken please check your side

Answer 12 · 2024-04-20T04:57:23.000Z

Uploading RPReplay_Final1713588799.mp4…

Answer 13 · 2024-04-20T09:40:28.000Z

Hi @iamjamilkhan

No probs, looked like I introduced a bug. Ive resolved that now so just perform another git pull and all should be good. Just make sure to ensure you:

have the 2.0.3 model
use API TTS mode.

Regarding the TTS generator, I don't personally read or write Devanagari script. The TTS generator splits on a period/full stop to delimit the sentences. My best guess is that in Devanagari script you don't use a period/full stop to delimit sentences. As such I doubt the TTS generator will split correctly, if at all.

If you can provide me a simple, This is the character that Hindi uses to split sentences, then I can attempt to introduce it, however, remember I have no understanding of Hindi and Devanagari script. so testing is also hard for me to confirm if things work correctly as/when it would split.

Thanks

Answer 14 · 2024-04-20T10:01:14.000Z

thanks alot for such supporting you are great brother have a wonderful day and will gonna donate for it sure ❤️❤️❤️❤️and will let’s you know if found anything doubtful