How to make use of GRL for speaker about whisper-vits-svc HOT 3 CLOSED

https://github.com/PlayVoice/so-vits-svc-5.0/blob/main/vits/modules_grl.py
it will be used to finetune model, after base model trained. I still train base model, now.

this code will be added for the finetune

x = self.enc(x * x_mask, x_mask)

-- Speaker Classifier
speaker_posterior = self.speaker_classifier(x)
LOSS
self.nll_loss = nn.NLLLoss()
adv_loss = self.nll_loss(speaker_posteriors, speaker_targets[序号]):

but use speaker vector for loss

more info for GRL can be finded here:https://github.com/ubisoft/ubisoft-laforge-daft-exprt/blob/master/src/daft_exprt/model.py

from whisper-vits-svc.

At the finetune stage, PosteriorEncoder should be frozen, if you want to try GRL now.

from whisper-vits-svc.

great, thanks :)

from whisper-vits-svc.