goodpaas / probing-tts-models Goto Github PK

link to pdf

Audio samples can be found here: online demo

All synthesized stimuli can be accessed here.

Traning data can be found here.

You can directly run the TTS models (Tacotron2 and WaveGlow) on Google Colab (with a powerful GPU).

torch == 1.1.0

1. Download pre-trained Mandarin models at this folder.
2. Download pre-trained Chinese BERT (BERT-wwm-ext, Chinese).
3. Run ``inference_bert.ipynb''
   Or:
   Use the following command line.

python synthesize.py --text ./stimuli/tone3_stimuli --use_bert --bert_folder path_to_bert_folder 
--tacotron_path path_to_pre-trained_tacotron2 --waveglow_path path_to_pre-trained_waveglow 
--out_dir path_output_dir

Note. The current implementation is based on the Nvidia's public implementation of Tacotron2 and Waveglow

This project has benefited immensely from the following works.
Pre-Trained Chinese BERT with Whole Word Masking
Tacotron 2 - PyTorch implementation with faster-than-realtime inference
WaveGlow: a Flow-based Generative Network for Speech Synthesis
A Demo of MTTS Mandarin/Chinese Text to Speech FrontEnd
Open-source mandarin speech synthesis data
只用同一声调的字可以造出哪些句子？