Using MobileNet instead of VGG16 about d2-net HOT 5 CLOSED

Dear Rolf. It is true that the off-the-shelf version of MobileNetV2 might not be directly adequate for the D2 approach: as for ResNets, you would need to go to ~1/16th of input resolution to get a similar performance to the VGG counterpart. However, there are a few things that you could try:

1. As we did for VGG at test time, modifying the network to use dilated convolutions and no stride for the last block before the cut. This would get you to 1/8th of the resolution without any need for re-training.

2. To further improve the resolution, MobileNetV2 can be modified to obtain a lower stride. One could do this by either moving the strided convolutions at the end of each block (instead of the beginning) or by simply removing the stride of the first block. However, this would require re-training on ImageNet since the receptive fields of all layers would be completely different.

from d2-net.

Hello Mihai, thanks for the fast answer and the suggestions. I will try #1, and also test convolutional transpose. I'm shying back a bit from fully retraining MobileNet.
Have a nice day!

from d2-net.

Hi, @mihaidusmanu ,in the suplementary material it set K=4 for mining harder samples because the receptive field of conv_3 is 65x65 for VGG.However, doesn't it is 92x92 for conv4_3? so the K may be set 8?

from d2-net.

@Lakaemper Hi Lakaemper, I am working about trying to get D2 faster too. So I am wondering about werther it works with MobileNetV2. Thank you!

from d2-net.

I will close this issue since there are no recent updates. Feel free to re-open a new one if you run into any issues with the provided code.

from d2-net.