PC-DARTS on medical images classification about pc-darts HOT 5 CLOSED

Hi, thanks for your interest of our work. I have never down that on medical datasets, but i am willing to help with you. You said you run some tests and got 58% accuracy. What architecture did you use? the searched architecture by our paper, or searched by yourself, our the supernet accuracy?

from pc-darts.

Thanks for your fast reply.
I'am still at the stage of : architecture search, so i run it for 100 epochs, i got a low validation over all epochs ( fluctuating between 40 and 58 % ) , same thing for the training accuracy.

I use 180x180 breast cancer patches, i got about 3996 images for train, 1330 for validation. So i may say that i am in a situation of "lack of data", the other question is regarding the : arch learning rate , the main model learning rate, since they're tuned to CIFAR10 or 100, it might be challenging for a medical dataset.

i'm stacking with this architecture for the last epochs :

genotype = Genotype(normal=[('dil_conv_3x3', 1), ('dil_conv_5x5', 0), ('sep_conv_5x5', 1), ('dil_conv_5x5', 2), ('dil_conv_3x3', 3), ('dil_conv_3x3', 1), ('avg_pool_3x3', 1), ('dil_conv_3x3', 4)], normal_concat=range(2, 6), reduce=[('avg_pool_3x3', 1), ('skip_connect', 0), ('skip_connect', 1), ('dil_conv_5x5', 2), ('skip_connect', 1), ('dil_conv_3x3', 3), ('skip_connect', 1), ('dil_conv_5x5', 4)], reduce_concat=range(2, 6))

I'll appreciate your help.

from pc-darts.

I may also have some comments about memory uses , i am running my code on : Quadro RTX 6000 with ( batch size of 16, same initial channels and layers as main script(16,8) and 180x180 resolution images as i mentioned before. So i am kind of limited to use a higher batch size or a deeper net.

from pc-darts.

Hi, first of all, I need to mention that the accuracy of the supernet during the search phase may not that important(e.g. the validation accuracy on Imagenet is only 32%). You need to evaluate the architecture searched on the whole dataset. Second, as the image size of your dataset is much larger that cifar you need to first downsample the image to (32x32) using some downsampling layers just like the search on ImageNet. You may shorten the number of search epochs I think. learning rate you should follow the common settings on the medical dataset.

from pc-darts.

Hello again,
Thanks for the reply, i guess the down sampling is a good idea.
Another unclear point, in your case you said you got 32% on validation during the search phase but still had good performance for the whole training. So is there any signs ( besides loss ) to say that my search phase was good ?

Thanks in advance for your answer.

from pc-darts.