ALBERT sentence order weights are randomly initialized about corpg HOT 3 OPEN

The ALBERT model provided by huggingface does not include the parameters of the final classification layer, and transformers will random initial its parameters. So you should finetune the ALBERT with your training dataset. And we also release our finetuned ALBERT on the release page.

NOTE: You should only leverage the training dataset rather than the whole dataset include validation and test dataset to finetune the ALBERT model, this can make sure the accuracy and fairness of the COH and COH-p.

from corpg.

rameters of the final classification layer, and transformers will random initial its parameters. So you should finetune the ALBERT with your traini

Excuse me, I can't load the Albert.bin . Could you show me how to use the Albert.bin file to load the Finetune model. Thank you !!!

from corpg.

rameters of the final classification layer, and transformers will random initial its parameters. So you should finetune the ALBERT with your traini

Excuse me, I can't load the Albert.bin . Could you show me how to use the Albert.bin file to load the Finetune model. Thank you !!!

I couldn't too,do you find any solutions to solve about it.

from corpg.