Demo on Colab, possible improvements? about tts-cube HOT 11 CLOSED

@roodrallec , your notebook is excellent. I would like to include it as a runtime example for TTS-Cube, if this is ok with you. I'm actually working on a better model which uses g2p and global style tokens for English. I have some examples here, but it's still in progress. However, they seem better than the current model.

Also, I'm training a waveglow as a vocoder, to see if it provides better e2e results.

from tts-cube.

Sure, use it as you please. Waveglow samples sound awesome... Good luck!

from tts-cube.

Hi @roodrallec ,

I've just updated the examples for English and pushed the models. It would be great if you could update your Notebook to use this branch instead. You have to copy the nn and pnn networks from the models file (not just the encoder). Also, for synthesis, you need to specify the g2p model and speaker:

python3 cube/synthesis.py --target-sample-rate=16000 --g2p-model=data/models/en-g2p --input-file=../test.en.1 --output-file=../en/cat.test.en.1.wav --speaker=cat --use-gpu

The list of speakers is:

SPEAKER:cat	
SPEAKER:clb	
SPEAKER:lnh	
SPEAKER:eey	
SPEAKER:aew
SPEAKER:fem	
SPEAKER:bdl
SPEAKER:ksp	
SPEAKER:rms	
SPEAKER:axb	
SPEAKER:jmk
SPEAKER:ahw	
SPEAKER:gka	
SPEAKER:ljm
SPEAKER:rxr
SPEAKER:awb	
SPEAKER:lj	
SPEAKER:slp	
SPEAKER:slt
SPEAKER:aup	

from tts-cube.

@roodrallec : I actually changed your notebook a little. Thanks again for sharing. I would really like to include this as a tutorial, but I think it would be fair for you to do the pull request. This is my current version of code: tts-cube-test

from tts-cube.

Sure, which folder would you like it in?

from tts-cube.

The examples folder would be great. I think it would be ok to also link this from README.md

Thanks again!

from tts-cube.

I think I need push access to the repo, unless there's a magic way to create a PR without permissions from an open issue.

from tts-cube.

I just added you as a collaborator. Normally, you can always create a PR from your fork, if tou are not a collaborator on a repo.

from tts-cube.

Awesome, all done, thanks. I was going to use TTS cube as one of the components for my master thesis, but ran out of time unfortunately. Did you create TTS cube as part of a research project?

from tts-cube.

It was just for fun, I guess

from tts-cube.

Do you think this issue can be closed?

from tts-cube.