The result of swin-small backbone on ADE about mask2former HOT 7 CLOSED

ADE20K (and Cityscapes) dataset has very large variance, please try to train the model for 5 times, the median results should match the one we reported.

from mask2former.

Thanks for your reply, I will try to train the network again. Is it because I just use 4 GPUs while you train the network with 8 GPUs?

from mask2former.

As long as you used the same batch size, the number of GPU does not matter.

from mask2former.

Thanks for your reply.

I have trained the network multiple times and the best result is 50.9. I find the variance is significantly large.

from mask2former.

Hi, @bowenc0221 , would you mind providing the variance for those methods and dataset? It is difficult to evaluate the method to compare the methods since the variance is so large.

from mask2former.

I don't have the variance for Mask2Former, but for the ADE20K and Cityscapes dataset we report the median of 3 runs. You can find the standard deviation (std) on the ADE20K dataset in our MaskFormer paper (https://arxiv.org/abs/2107.06278). Mask2Former should have a similar std.

from mask2former.

Thanks for your reply.

from mask2former.