228 lines
9.9 KiB
Markdown
228 lines
9.9 KiB
Markdown
<div align="center">
|
|
|
|
<h1>Retrieval-based-Voice-Conversion-WebUI</h1>
|
|
An easy-to-use voice conversion framework based on VITS.<br><br>
|
|
|
|
[](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI)
|
|
|
|
<img src="https://counter.seku.su/cmoe?name=rvc&theme=r34" /><br>
|
|
|
|
[](https://colab.research.google.com/github/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/blob/main/tools/ipynb/v1.ipynb)
|
|
[](https://colab.research.google.com/github/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/blob/main/tools/ipynb/v2.ipynb)
|
|
[](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/blob/main/LICENSE)
|
|
[](https://huggingface.co/lj1995/VoiceConversionWebUI/tree/main/)
|
|
|
|
[](https://discord.gg/HcsmBBGyVk)
|
|
|
|
[**Changelog**](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/blob/main/docs/Changelog_EN.md) | [**FAQ (Frequently Asked Questions)**](https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/wiki/FAQ-(Frequently-Asked-Questions))
|
|
|
|
[**English**](../en/README.en.md) | [**中文简体**](../../README.md) | [**日本語**](../jp/README.ja.md) | [**한국어**](../kr/README.ko.md) ([**韓國語**](../kr/README.ko.han.md)) | [**Français**](../fr/README.fr.md) | [**Türkçe**](../tr/README.tr.md) | [**Português**](../pt/README.pt.md)
|
|
|
|
</div>
|
|
|
|
> The base model is trained using nearly 50 hours of high-quality open-source VCTK training set. Therefore, there are no copyright concerns, please feel free to use.
|
|
|
|
> Please look forward to the base model of RVCv3 with larger parameters, larger dataset, better effects, basically flat inference speed, and less training data required.
|
|
|
|
> There's a [one-click downloader](https://github.com/RVC-Project/RVC-Models-Downloader) for models/integration packages/tools. Welcome to try.
|
|
|
|
<table>
|
|
<tr>
|
|
<td align="center">Training and inference Webui</td>
|
|
<td align="center">Real-time voice changing GUI</td>
|
|
</tr>
|
|
<tr>
|
|
<td align="center"><img src="https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/assets/129054828/092e5c12-0d49-4168-a590-0b0ef6a4f630"></td>
|
|
<td align="center"><img src="https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/assets/129054828/730b4114-8805-44a1-ab1a-04668f3c30a6"></td>
|
|
</tr>
|
|
<tr>
|
|
<td align="center">go-web.bat</td>
|
|
<td align="center">go-realtime-gui.bat</td>
|
|
</tr>
|
|
<tr>
|
|
<td align="center">You can freely choose the action you want to perform.</td>
|
|
<td align="center">We have achieved an end-to-end latency of 170ms. With the use of ASIO input and output devices, we have managed to achieve an end-to-end latency of 90ms, but it is highly dependent on hardware driver support.</td>
|
|
</tr>
|
|
</table>
|
|
|
|
## Features:
|
|
+ Reduce tone leakage by replacing the source feature to training-set feature using top1 retrieval;
|
|
+ Easy + fast training, even on poor graphics cards;
|
|
+ Training with a small amounts of data (>=10min low noise speech recommended);
|
|
+ Model fusion to change timbres (using ckpt processing tab->ckpt merge);
|
|
+ Easy-to-use WebUI;
|
|
+ UVR5 model to quickly separate vocals and instruments;
|
|
+ High-pitch Voice Extraction Algorithm [InterSpeech2023-RMVPE](#Credits) to prevent a muted sound problem. Provides the best results (significantly) and is faster with lower resource consumption than Crepe_full;
|
|
+ AMD/Intel graphics cards acceleration supported;
|
|
+ Intel ARC graphics cards acceleration with IPEX supported.
|
|
|
|
Check out our [Demo Video](https://www.bilibili.com/video/BV1pm4y1z7Gm/) here!
|
|
|
|
## Environment Configuration
|
|
### Python Version Limitation
|
|
> It is recommended to use conda to manage the Python environment.
|
|
|
|
> For the reason of the version limitation, please refer to this [bug](https://github.com/facebookresearch/fairseq/issues/5012).
|
|
|
|
```bash
|
|
python --version # 3.8 <= Python < 3.11
|
|
```
|
|
|
|
### Linux/MacOS One-click Dependency Installation & Startup Script
|
|
By executing `run.sh` in the project root directory, you can configure the `venv` virtual environment, automatically install the required dependencies, and start the main program with one click.
|
|
```bash
|
|
sh ./run.sh
|
|
```
|
|
|
|
### Manual Installation of Dependencies
|
|
1. Install `pytorch` and its core dependencies, skip if already installed. Refer to: https://pytorch.org/get-started/locally/
|
|
```bash
|
|
pip install torch torchvision torchaudio
|
|
```
|
|
2. If you are using Nvidia Ampere architecture (RTX30xx) in Windows, according to the experience of #21, you need to specify the cuda version corresponding to pytorch.
|
|
```bash
|
|
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu117
|
|
```
|
|
3. Install the corresponding dependencies according to your own graphics card.
|
|
- Nvidia GPU
|
|
```bash
|
|
pip install -r requirements.txt
|
|
```
|
|
- AMD/Intel GPU
|
|
```bash
|
|
pip install -r requirements-dml.txt
|
|
```
|
|
- AMD ROCM (Linux)
|
|
```bash
|
|
pip install -r requirements-amd.txt
|
|
```
|
|
- Intel IPEX (Linux)
|
|
```bash
|
|
pip install -r requirements-ipex.txt
|
|
```
|
|
|
|
## Preparation of Other Files
|
|
### 1. Assets
|
|
> RVC requires some models located in the `assets` folder for inference and training.
|
|
#### Download Automatically (Default)
|
|
By default, RVC can automatically check and download the required resources when the main program starts. If the download fails, you can also choose to manually download and place them in the corresponding location.
|
|
|
|
#### Download Manually
|
|
> All resource files are located in [Hugging Face space](https://huggingface.co/lj1995/VoiceConversionWebUI/tree/main/)
|
|
|
|
> You can find some scripts to download them in the `tools` folder
|
|
|
|
> You can also use the [one-click downloader](https://github.com/RVC-Project/RVC-Models-Downloader) for models/integration packages/tools
|
|
|
|
Below is a list that includes the names of all pre-models and other files required by RVC.
|
|
|
|
- ./assets/hubert/hubert_base.pt
|
|
```bash
|
|
rvcmd assets/hubert # RVC-Models-Downloader command
|
|
```
|
|
- ./assets/pretrained
|
|
```bash
|
|
rvcmd assets/v1 # RVC-Models-Downloader command
|
|
```
|
|
- ./assets/uvr5_weights
|
|
```bash
|
|
rvcmd assets/uvr5 # RVC-Models-Downloader command
|
|
```
|
|
If you want to use the v2 version of the model, you need to download additional resources in
|
|
|
|
- ./assets/pretrained_v2
|
|
```bash
|
|
rvcmd assets/v2 # RVC-Models-Downloader command
|
|
```
|
|
|
|
### 2. Install ffmpeg tool
|
|
If `ffmpeg` and `ffprobe` have already been installed, you can skip this step.
|
|
#### Ubuntu/Debian
|
|
```bash
|
|
sudo apt install ffmpeg
|
|
```
|
|
#### MacOS
|
|
```bash
|
|
brew install ffmpeg
|
|
```
|
|
#### Windows
|
|
After downloading, place it in the root directory.
|
|
```bash
|
|
rvcmd tools/ffmpeg # RVC-Models-Downloader command
|
|
```
|
|
- [ffmpeg.exe](https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/ffmpeg.exe)
|
|
|
|
- [ffprobe.exe](https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/ffprobe.exe)
|
|
|
|
### 3. Download the required files for the rmvpe vocal pitch extraction algorithm
|
|
|
|
If you want to use the latest RMVPE vocal pitch extraction algorithm, you need to download the pitch extraction model parameters and place them in the RVC root directory.
|
|
|
|
- [rmvpe.pt](https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/rmvpe.pt)
|
|
```bash
|
|
rvcmd assets/rmvpe # RVC-Models-Downloader command
|
|
```
|
|
|
|
#### Download DML environment of RMVPE (optional, for AMD/Intel GPU)
|
|
|
|
- [rmvpe.onnx](https://huggingface.co/lj1995/VoiceConversionWebUI/blob/main/rmvpe.onnx)
|
|
```bash
|
|
rvcmd assets/rmvpe # RVC-Models-Downloader command
|
|
```
|
|
|
|
### 4. AMD ROCM (optional, Linux only)
|
|
|
|
If you want to run RVC on a Linux system based on AMD's ROCM technology, please first install the required drivers [here](https://rocm.docs.amd.com/en/latest/deploy/linux/os-native/install.html).
|
|
|
|
If you are using Arch Linux, you can use pacman to install the required drivers.
|
|
````
|
|
pacman -S rocm-hip-sdk rocm-opencl-sdk
|
|
````
|
|
For some models of graphics cards, you may need to configure the following environment variables (such as: RX6700XT).
|
|
````
|
|
export ROCM_PATH=/opt/rocm
|
|
export HSA_OVERRIDE_GFX_VERSION=10.3.0
|
|
````
|
|
Also, make sure your current user is in the `render` and `video` user groups.
|
|
````
|
|
sudo usermod -aG render $USERNAME
|
|
sudo usermod -aG video $USERNAME
|
|
````
|
|
## Getting Started
|
|
### Direct Launch
|
|
Use the following command to start the WebUI.
|
|
```bash
|
|
python infer-web.py
|
|
```
|
|
### Linux/MacOS
|
|
```bash
|
|
./run.sh
|
|
```
|
|
### For I-card users who need to use IPEX technology (Linux only)
|
|
```bash
|
|
source /opt/intel/oneapi/setvars.sh
|
|
./run.sh
|
|
```
|
|
### Using the Integration Package (Windows Users)
|
|
Download and unzip `RVC-beta.7z`. After unzipping, double-click `go-web.bat` to start the program with one click.
|
|
```bash
|
|
rvcmd packs/general/latest # RVC-Models-Downloader command
|
|
```
|
|
|
|
## Credits
|
|
+ [ContentVec](https://github.com/auspicious3000/contentvec/)
|
|
+ [VITS](https://github.com/jaywalnut310/vits)
|
|
+ [HIFIGAN](https://github.com/jik876/hifi-gan)
|
|
+ [Gradio](https://github.com/gradio-app/gradio)
|
|
+ [FFmpeg](https://github.com/FFmpeg/FFmpeg)
|
|
+ [Ultimate Vocal Remover](https://github.com/Anjok07/ultimatevocalremovergui)
|
|
+ [audio-slicer](https://github.com/openvpi/audio-slicer)
|
|
+ [Vocal pitch extraction:RMVPE](https://github.com/Dream-High/RMVPE)
|
|
+ The pretrained model is trained and tested by [yxlllc](https://github.com/yxlllc/RMVPE) and [RVC-Boss](https://github.com/RVC-Boss).
|
|
|
|
## Thanks to all contributors for their efforts
|
|
<a href="https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/graphs/contributors" target="_blank">
|
|
<img src="https://contrib.rocks/image?repo=RVC-Project/Retrieval-based-Voice-Conversion-WebUI" />
|
|
</a>
|