Aboat training about edvr HOT 4 OPEN

ft_tsa_only: only finetune TSA module
We first train a model w/o TSA. Then we add the TSA module and only finetune TSA for some iterations. After that, we finetune the whole model.

from edvr.

I wanted to make sure I understood is correctly. Is this how the complete training goes:

1. Train the model with only PCD and reconstruction modules i.e. woTSA,
2. Train only TSA module.
3. Train the full EDVR with everything in place.

If that is the case; can you please answer the following questions:

1. For how long you train woTSA?
2. How to train only TSA module? Is there a setting I can do in the yml file? And how long this should be trained/fine-tuned?

from edvr.

Hi, by looking at the provided log files; it feels you are first training for 600K iterations woTSA and then using this pre-trained model, further training for another 600K iterations with TSA module in place. Is this correct?

Why fine-tuning based on TSA required equal amount of training?

from edvr.

1. Yes, correct.
2. I think we can shorten the training iteration without affecting the performance much. I set it the same as the first stage, for simplicity.

from edvr.