Add synchronised audio to video file doesn't work for me.
Closed this issue · 7 comments
I'm thrilled, it works really well! Add synchronised audio to video file doesn't work for me I don't know maybe it's the video codec? No audio file is extracted. And the dubbing from .srt subtitle files is very slow. For a 60min video it takes 3+ hours with XTTS. But still better than having to do it manually. Regards really great work.
I'm sorry to hear it doesn't work, I will check if I haven't broken something recently. Can you please tell me what video container, audio and video codec the video file you tried had?
What GPU do you have? Is TTS from a text file faster than from SRT?
YouTube video downloaded with the JDownloader. MP4 format. I have an RTX4090 so it can't be the GPU. But what I have to say, I'm using a fine-tuned 0.2.2 model. The interface(client) is also laggy(delayed). I have not tried normal TXT generation now.
laggy.mp4
Did the file have the .mp4 or .webm extension? Are you on Linux or Windows?
Windows11 and it is an mp4. I have found the "bug", I have to activate Add synchronised audio to video file. (Then the generation works continuously ) But I can't extract an audio file from a video, not even from other videos.
bug.mp4
I think I may know what has gone wrong. I included "ffmpeg" instead of "ffmpeg-python" in the requirements. Could you please do pip install ffmpeg-python or conda\Scripts\conda.exe run -n pandrator_installer pip install ffmpeg-python from inside the Pandrator folder if you used the installation script and see if it helps? I still don't know about the lagginess, unless it's related to this issue as well. You can also remove the Pandrator folder and run the installation script again, it will install correct dependencies now.
PS. If you decide to update the conda env, you should do pip uninstall ffmpeg before installing ffmpeg-python.
pip uninstall ffmpeg-python/pip install ffmpeg-python Did not work, no change. I have now installed your new update. And now everything works. Super thanks.