/GhostCut-auto_video_translation

auto video translation-video translator can auto translate video hard subtitles, auto video translation and dubbing, remove any video text, auto remove video subtitles/text. 自动视频翻译配音,自动翻译视频字幕和回填样式,自动硬字幕翻译。

Primary LanguagePython

Welcome to GhostCut

Auto video localization tool, AI based, translate everything

GhostCut is an automatic localization tool allowing you to translate videos into 40+ languages efficiently. With "Smart-Text/Watermark-Removal" and "Hard-Sub-Translation" functions, you can easily handle hard subtitles and improve efficiency by 100 times.

Here are some video demos.

Latest Product Updates

  • 10.12-# AI image tool launchend: Image Text Removal and Image Translator . Excellent effect, global leading, free to use.
  • 09.26-#GhostCut Video Remaker update : new [advanced remaker] - support short drama remaker / commentary remaker
  • Support AI one-click rewriting, regenerate copy, dubbing and subtitles according to the original content, and flexibly match deduplicate to greatly improve remaker ;
  • Add subtitle position inference to effectively avoid erasure of scene text.
  • 9.13- #GhostCuit and TiKTok Auto post release:
  • Deduplicate function update : add a variety of deduplicate methods, random mirroring, random acceleration, color matching, etc., open head and tail, frame extraction and other operation options, users can customize deduplicate operation
  • The work page adds TiKTok one-click posting function , which can be directly bound and post to TikTok account, authorized by the official interface, and the processed works can be published overseas with one click to TikTok
  • 08.04-#GhostCutweb version update, simpler page layout, clearer introduction, web version supports various online adjustments, welcome to experience.
  • 07.28-# API is open, GhostCut supports use of online API , more autonomous, simpler, and more combinations can be supported. The entrance is on the homepage of the web page.
  • 06.05- #618 Welfare Broadcast
  • Benefit 1: The original quarterly membership package has been upgraded to a semi-annual one, with no price increase for overtime
  • Benefit 2: Receive expired points. Purchasing any package can retrieve points that expire within 30 days.
  • 05.14-#Translation product update: GhostCut has launched an online hard subtitle editing feature, which allows users to adjust the text content of hard subtitle translation on their computer.
  • 04.18-#Translation product update: The mobile version of GhostCut has added the function to translate video sound and text, as well as adjust subtitle translation directly within the mobile app. Users can modify the text and style of their translated works without using a computer, and can also compare and adjust the copy of new and old videos.
  • 04.17-#GhostCut Translation Update: Video speech translation segmental speed adjustment is now available, fully guaranteeing alignment between speech, picture, and subtitles. More precise alignment and stable pronunciation are achieved;
  • 03.28-#GhostCut Website Update: Video Hard Sub Translation feature launched on the web version, with the ability to simultaneously translate video text and add intelligent background music in one go;
  • 03.23-#GhostCut TTS Update: Update commonly used voices from editing apps such as Jianying (Douyin) and CapCut, such as Northeastern Iron, Guangxi Zhuanghan, English vitality Ariana;
  • 03.15-#GhostCut API Update: Opened APIs for multiple exclusive products such as Video remaker, video text removal, Video Hard Sub Translation, and video translation and dubbing;
  • 03.09-#GhostCut Translation Product Update: All translation engines used ChatGPT API, with higher accuracy, especially for translation between small country languages;
  • 01.16-#GhostCut Translation Product Update: Video Hard Sub Translation product launched.

1. GhostCut - AI Video Editing Tool

GhostCut is an intelligent video editing software. Its core purpose is to help customers improve the processing speed of materials and the quality of video creativity. We have used a lot of AI capabilities in various audio and video processing details to improve the processing efficiency of many videos. It has several unique features, including automatic video translation and dubbing, automatic hard subtitle translation, automatic hard sub/text removal, intelligent video inpainting, and more. Every detail of this product is a combination of AI and automation.

These are some of our exclusive features.

  1. [Smart Text Removal] Automatically detect all text/subtitles in the video through OCR and perform video inpainting to restore the erased video parts as much as possible;
  2. [Auto Hard Sub Translation] Automatically detect the text/subtitles in the video through OCR, calculate and extract text position, style, size in the video, and then use ChatGPT to translate the subtitles and paste them back according to the original text style and position, while performing inpainting on the original text area;
  3. [Auto Translation and dubbing] Automatically extract the voice in the video through ASR and translate it, while using TTS to synthesize the translated text into voice. In this process, the position of the original picture, voice, and subtitles is calculated, and the newly synthesized voice, subtitles, and original picture are automatically aligned to ensure the consistency of sound and picture. You can choose whether to perform inpainting smudging on the original text and whether to retain the original sound. The effect of retaining the original sound is to automatically separate the human voice and background music of the original video and retain the background music.
  4. [Auto Video remaker] Automatically make minor modifications to the video, and automatically complete the following operations, including but not limited to modifying md5, removing video fingerprints, superimposing picture-in-picture in the video, minor cropping, using Gaussian blur, automatic cover clipping, slightly tilting the picture, using sharpening, using acceleration and deceleration, and other transitions, filters, scaling, etc. Generally used for quick secondary creation for short video.
  5. [Image Translator and text removal] GhostCut image translation service is a newly launched. It’s an AI image translation product. It integrates multiple latest AI models, optimizes the translation quality, style layout and text backfilling as a whole, and improves the quality of picture translation to a new level.

2. Product Features

1.GhostCut Use lots of the latest AI technologies + audio and video processing algorithms to improve processing effects as much as possible;

2.Adopt automated and intelligent design concepts, end-to-end problem solving, and deliver finished products as much as possible;

3.All APIs and intermediate products are open for easy integration.

3. Video Demos

Free Try GhostCut There are Chinese and English versions. Mainland users can access product in WeChat mini program, search GhostCut.

Smart Text Removal- video demos

This is Smart Text Removal and Video Inpainting demo video. If you need to learn about video inpainting, please to visit the video inpainting introduction. Compared to other text removal software, such as Runway's Inpainting feature, GhostCut's text removal(Inpainting) is simpler, smarter, and more affordable. You can check the specific differences between GhostCut and Runway in Video Inpainting here: Difference between GhostCut and Runway in Video Inpainting

What kind of texts can GhostCut automatically remove ? Specifically as follows

Video Hardcode subtitles Translation-video samples

GhostCut hard Subtitle Translation recognizes the "text" in the original video by OCR and generates translated text. It also uses AI to remove the original video text, and then re-pastes the translated text back into the original text position, while trying to retain the original text's size, color, and layout as much as possible. Compared with using multiple editing and translation software, the Specialty of GhostCut are: fully automatic, one-click removal of original text, and retention of the original video text layout.

Video Translation and Dubbing-video samples

The translated video comes with synchronized voiceover, please click here to view the video effect YouTube Video Voice Translation Case

GhostCut translate the video with both voice and text

4. Specific AI Editing Capabilities

  • Support basic Video remaker, one-time basic micro-cropping
  • Support overlay video special effects 1.Scan light effects 2.Glare opening effects 3.Descending opening effects 4.Book list mode effects 5.Dissolving mode effects 6.Horizontal video three-screen display effects 7.Good things effects 8.Film and television effects
  • Support overlay random transitions, random scaling, random borders, mirror reversal
  • Support algorithmic automatic music matching, calculate the rhythm of the original video and *automatically match music with similar rhythm
  • Support matching specified music
  • Support re-write the captions and AI dubbing
  • Support change the subtitles fonts and style
  • Support automatic text removal, first mark the area and only automatically remove the text in marked area, remove all after marking the area, adjust the protection or erasure area and re-synthesize
  • Support removal of moving text/moving text watermark
  • Support automatic detection of video subject and upper and lower edges, and refill the background outside the video main subject

Video Translation And Dubbing Details

  • Support ASR to extract video voice and translate
  • When ASR extracts video sound, separate human voice and background sound, and only translate human voice
  • Support mute after translation, or retain background sound, or algorithmic music matching or specified music matching
  • Support only generate translated subtitles (without TTS synthesis)
  • Support translation subtitles and TTS voice synthesis (automatically calculate the position of subtitles, pictures, and sound during synthesis)

Video Hard subtitles Translation Details

  • Support OCR to extract video text and translate
  • When OCR extracts video text, support text position and style extraction
  • TTS synthesis for translated text will be supported soon.
  • Clean erasure
  • Neat typography
  • Picture Clarity
  • Translation Accuracy
  • 100+ languages support
  • Product text protection
  • Vertical support
  • Multi-line support
  • API support
  • Private deployment

5. Technical Details

  • Voice: Self-developed ASR and TTS combined with engines such as iFlytek, Alibaba Cloud, Google, Microsoft, and ByteDance Volcano;
  • Translation: Comprehensive use of iFlytek, Deepl, ChatGPT translation, etc.;

6. Supported Languages for Translation

  • Smart Text Removal: Remove both Chinese and English at the same time, or remove Chinese, English, Japanese, Korean, and Arabic separately;
  • Auto Video Hard Sub Translation: Source language: Chinese or English; Target language: Chinese/English/Japanese/Indonesian/Portuguese/French/Spanish/Hindi/Arabic/Vietnamese/Thai/German/Russian/Turkish/Italian/Philippines/Malaysia/Khmer
  • Auto Video Translation and Dubbing: Source language: Chinese/English/Japanese/Korean/Spanish/Italian/Russian/French/Portuguese/Vietnamese/Thai, etc.; Target language: Chinese/English/Japanese/Indonesian/Portuguese/French/Spanish/Hindi/Arabic/Vietnamese/Thai/German/Russian/Turkish/Italian/Vietnamese
  • Image Translation:100+ languages

7. API Interface Support

  • 1.Provides output for all the above capabilities, including Video remaker and editing, automatic text removal, video erasure, video subtitle translation, video voice translation (including dubbing), and other interfaces. Multiple capabilities can be stacked and selected together;
  • 2.Text removal supports the following four modes, and you can customize the protection area or specify the deletion area:

a. Automatic text removal

b. First mark the specified area, and then automatically remove the text in the specified area

c. First mark the area, and then remove all the contents of the marked area

d. After removing the text, adjust the specified area later

  • 3.Video translation can be used together with multiple editing capabilities: One-click completion: Video remaker + automatic text removal + video translation + video music matching and other operations (including translated dubbing)
  • 4.API documents
  • 5.GhostCut User Guides

8. Contact Us

  • WeChat: 360254, please indicate GitHub in the remark.
  • Email:niumoz#izhaoli.com(#-->@)