As we detailed in our paper and website, the advantages of OpenVoice are three-fold:
1. Accurate Tone Color Cloning. OpenVoice can accurately clone the reference tone color and generate speech in multiple languages and accents.
2. Flexible Voice Style Control. OpenVoice enables granular control over voice styles, such as emotion and accent, as well as other style parameters including rhythm, pauses, and intonation.
3. Zero-shot Cross-lingual Voice Cloning. Neither of the language of the generated speech nor the language of the reference speech needs to be presented in the massive-speaker multi-lingual training dataset.
openvoice.mp4
OpenVoice has been powering the instant voice cloning capability of myshell.ai since May 2023. Until Nov 2023, the voice cloning model has been used tens of millions of times by users worldwide, and witnessed the explosive user growth on the platform.
- Zengyi Qin at MIT and MyShell
- Wenliang Zhao at Tsinghua University
- Xumin Yu at Tsinghua University
- Ethan Sun at MyShell
Please see usage for detailed instructions.
Please see QA for common questions and answers. We will regularly update the question and answer list.
Join our Discord community and select the Developer role upon joining to gain exclusive access to our developer-only channel! Don't miss out on valuable discussions and collaboration opportunities.
@article{qin2023openvoice,
title={OpenVoice: Versatile Instant Voice Cloning},
author={Qin, Zengyi and Zhao, Wenliang and Yu, Xumin and Sun, Xin},
journal={arXiv preprint arXiv:2312.01479},
year={2023}
}
This repository is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License, which prohibits commercial usage. This will be changed to a license that allows Free Commercial usage in the near future. Stay tuned. For social responsibility and anti-misuse considerations, MyShell reserves the ability to detect whether an audio is generated by OpenVoice, no matter whether the watermark is added or not.
This implementation is based on several excellent projects, TTS, VITS, and VITS2. Thanks for their awesome work!