video-translation: A Python repository from Crossme0809

video-translation

video-translation is an ongoing project leveraging OpenAI Whisper and the OpenAI API (TTS) to accomplish the following objectives:

Video Download: ✅
Extract Audio from Video: Default format is mp3. ✅
Generate Subtitles from Audio and Translate: ✅
Embed Hard Subtitles into Videos: ✅
Support for Video Production in Different Languages based on Subtitles: In progress

Hence, vt autonomously adds subtitles in multiple languages to both online and local videos. Future capabilities aim to automatically convert video voices into various languages. Feel free to follow and contribute to this project.

Setup

Begin by installing and updating using poetry:

poetry install

Additionally, ensure you have the command-line tool ffmpeg installed on your system. It's available via most package managers:

# on Ubuntu or Debian
sudo apt update && sudo apt install ffmpeg

# on Arch Linux
sudo pacman -S ffmpeg

# on MacOS using Homebrew (https://brew.sh/)
brew install ffmpeg

# on Windows using Chocolatey (https://chocolatey.org/)
choco install ffmpeg

# on Windows using Scoop (https://scoop.sh/)
scoop install ffmpeg

Command-line usage

There are two primary command-line usage types:

Generate Subtitle Files: Supports srt, vtt format based on video content. You can use video tools or website functions to add these subtitles to videos.
Directly Add Subtitles to Videos: Currently supports three methods of subtitle addition.

Generate subtitle files(Supports srt, vtt, json, txt, tsv and all format)

poetry run vt subtitle --path='https://www.bilibili.com/video/BV1tb4y1L7yA' --language=en --method=whisper --format=vtt --output=/Users/169/Downloads

Download video online and add subtitle

poetry run python main.py web --url=https://www.youtube.com/watch?v=CqRrByI-ONE

The web subcommand also supports more options, as follows:

poetry run vt web --help
Usage: vt web [OPTIONS]

Options:
  -u, --url TEXT        Video url.  [required]
  -o, --output TEXT     Generated video dir.
  -b, --bilingual TEXT  Use bilingual subtitle. Notice: this option is mutually exclusive
                        with subtitles.
  -s, --subtitles TEXT  Subtitle languages. split by ",". Notice: this option is mutually
                        exclusive with bilingual.
  --help                Show this message and exit.

Use local video and add subtitle

poetry run vt local --path='/Users/169/Movies/test.mov

The local subcommand also supports more options, as follows:

poetry run vt local --help
Usage: vt local [OPTIONS]

Options:
  -p, --path TEXT       Local file path.  [required]
  -o, --output TEXT     Generated video dir.
  -b, --bilingual TEXT  Use bilingual subtitle. you can specify the subtitle
                        language by `--subtitles`. Notice: this option is
                        mutually exclusive with subtitles.
  -s, --subtitles TEXT  Subtitle languages. split by ",". Notice: this option
                        is mutually exclusive with bilingual.
  --help                Show this message and exit.

Add bilingual subtitles to local video

Use the --bilingual option to create bilingual subtitles. Separate the two languages with commas, with the first language on top and the latter at the bottom.

poetry run vt local --path="/Users/169/videos/Langchain C3_L6.mp4" --bilingual="cn,en" --output="/Users/169/Downloads"

Custom config

All configuration items reside in config.py.

The project also supports limited custom configuration. Add a file named local_settings.py within the project and include the settings you wish to override.

For instance, if the default debug is set to False in config.py, you can enable debug mode by adding debug = True in local_settings.py:

cat local_settings.py
debug = True

Crossme0809/video-translation