Questions towards hyper-parameters and the token post-processing about muavic HOT 1 CLOSED

Hi @joyolee.

Sorry for the late reply!

My team and I have added the training and decoding scripts recently, so feel free to check them. All hyper-parameters used for fine-tuning can be found in this YAML configuration file. However, we had to change a few parameters as shown in the training script

For your reference, the following are the answer to your questions:

how many warmup_steps?

10,000 steps

how many hold_steps?

always 0

how many decay_steps?

20,000 steps

And how many freeze_finetune_updates did you set?

non-English models used 4,000 steps out of 30,000 total steps. And the English model used 24,000 steps out of 90,000 total steps.

The second question is about punctuation removal and lowercasing before calculating WER. Because I also observed some special tokens, e.g. the music token ♪ in the dictionary. Which tokens have you removed and how?

Yes, we've used Fairseq's WerScorer which removes punctuations and lower-case the text.

I hope I answered all of your question. I'm gonna close this for now, but feel free to re-open it when needed.

from muavic.