zyxxmu / optg Goto Github PK

Hi I'm trying to load the pre-trained model and there are keys for the bias mask (".b_mask") but this is not in the model code so there are incompatible keys. I'm assuming this is an error but if not please comment.

Thank you.

Thanks for your nice work.
After I run your code. The results reported in the paper are not aligned with my training log. Could you help me solve this problem?

The top1 accuracy in the paper at 95% sparsity is: 72.45%
But my training result is: 71.096%

10/19 04:58:13 PM | epoch 99 sparsitytotal 95.00002587939761
10/19 04:59:26 PM | * Acc@1 71.096 Acc@5 90.478