This project is an unofficial implementation of UniCATS paper.

Please note that as the official implementation has been released for the CTX-vec2wav model, this repository will be using the same setup. This provides consistency and compatibility for future updates to the project.

Note: Please refer to the official implementations of CTX-text2vec and CTX-vec2wav.

To get started, run the following after going inside the repository's root directory:

pip install -e .

This project is using the LibriTTS dataset in the 24 kHz sampling rate. To follow the same dataset splits as in the paper, please follow the steps on this guide.

• VQ Diffusion by Microsoft
• UniCATS-CTX-vec2wav by cantabile-kwok

@article{du2023unicats,
  title={UniCATS: A Unified Context-Aware Text-to-Speech Framework with Contextual VQ-Diffusion and Vocoding},
  author={Du, Chenpeng and Guo, Yiwei and Shen, Feiyu and Liu, Zhijun and Liang, Zheng and Chen, Xie and Wang, Shuai and Zhang, Hui and Yu, Kai},
  journal={arXiv preprint arXiv:2306.07547},
  year={2023}
}