Assertion error during open-images training about cvpr20_lesa HOT 4 CLOSED

Hi Akshita,

Thanks for carefully inspecting the code.
The assertion should be 400 as there are 400 labels in the csv file.
I have corrected this in my latest commit (could not recall why 399 appears there).

Best,
Dat

from cvpr20_lesa.

Thank you @hbdat

from cvpr20_lesa.

@hbdat I also wanted to ask how many numbers of images do you have after masking for ZSL evaluation for open-images?

from cvpr20_lesa.

Hi @akshitac8,

The number of testing samples, used to computed mAP scores for ZSL and GZSL, are different across different labels.
This is because a sample could lack annotation for label ‘A’ but include annotation for label ‘B’.
Thus, such sample is only excluded when computing AP for ‘A’ but will be included for ‘B’.

We construct unseen labels such that they have at least 75 annotated samples in test set for reliable evaluation.

from cvpr20_lesa.