Inquiry about some parameter selection reason about avsr-tf1 HOT 5 CLOSED

Oh, is it correct the architecture of 'bimodal' is WLAS?

from avsr-tf1.

Hi @LeeYongHyeok

The dropout rate is not a parameter that we tuned in particular. 10% seems to be a common choice.

highway_encoder allows to wrap your cells with a rnn.HighwayWrapper. This is a feature that I tested some time ago and gave some promising results, yet I did not find time to investigate it in greater detail. Often, it is not the raw performance that I am interested in.

You are right, the bimodal architecture is the one that uses two attention mechanisms on the decoder side and concatenates the two resulting context vectors. It was the first bimodal architecture implemented in Sigmedia-AVSR, but I'll go with your suggestion and rename it soon for more clarity.

On LRS2 I typically train the system for 100 epochs at a constant learning rate of 0.001, although you could do much better with an advanced learning rate schedule.

from avsr-tf1.

Thanks for your reply, @georgesterpu

Do you plan to experiment with the LRS3 DB or publish the code?

from avsr-tf1.

We are still analysing the use of LRS3 in our experiments.

Generally, I will ensure that our work is fully reproducible and accessible once published.

There are already a few enhancements to this AVSR project, currently under a private repository while our work is under review.

from avsr-tf1.

Thanks for your reply @georgesterpu

I fully agree with your opinion.

So i close this issues. Thanks!

from avsr-tf1.