Validattion code for Overall Performance? about eda HOT 3 CLOSED

Thanks for your interest.
You can double-check it. In fact, the overall performance is already provided. Our final performance is determined using the semantic alignment results from the last layer of the Decoder. As shown below.

from eda.

Thanks for your great response. I find the performance for each head is 0. Do you konw why this happens?

from eda.

I apologize for forgetting to comment out these two lines. L174 - L175

# note only consider the last layer
if prefix != 'last_':
   continue

I only kept the evaluation output of the last layer. Actually, you only need to refer to the results from this layer.

from eda.