/Video_Translation_with_LipSync

Video Translation with LipSync with OpenAi's whisper for ASR, YourTTS for TTS, and Wav2lip for lip sync.

Primary LanguagePythonMIT LicenseMIT

Video_Translation_with_LipSync

Video Translation with LipSync with OpenAi's whisper for ASR, YourTTS for TTS, and Wav2lip for lip sync.

Demo

Demo: https://www.youtube.com/watch?v=KbACtJM4pps&ab_channel=BPRimal $$\newline$$ Input: Video of Dr. Santacruz speaking spanish $$\newline$$ Output: Input video translated into English with Lip sync and AI predicted voice of Dr. Santacruz speaking English. $$\newline$$

Medium

Medium: https://medium.com/@contactbp22/video-video-translation-with-lip-sync-e83f627a1f8