How to calculate the rank? about channel-pruning HOT 11 CLOSED

I have the same enquiries too...

from channel-pruning.

I guess we can deduce that from the protocol of resnet-50-2X, but I have the same enquiries too.

from channel-pruning.

Maybe this could help: https://github.com/yihui-he/channel-pruning/wiki/ResNet-perserving-ratio

from channel-pruning.

@slothkong Is it for spatial decomposition?
Does it help you figure out calculating the rank?

from channel-pruning.

@makitann I dont know exactly what spatial decomposition is. Maybe is best if you refer to the paper. I'm not sure how it affect rank either, but there seems to be a relation...

from channel-pruning.

@slothkong According to this paper, spatial decomposition (https://arxiv.org/abs/1405.3866) is one of the 3C method mentioned in the README.
Spatial decomposition use low rank to approximate the filter, therefore, how to decide the rank is apparently important. But the authors in spatial decomposition and this paper seems that do not show how to decide it and just set it in the code.

from channel-pruning.

@makitann That is 100% correct my friend. Is usually like that in papers about pruning algorithms. I'm trying to run test in different models, with different datasets (using channel pruning only ) to kind of get a big-picture view of what are the tolerable pruning degrees, if I manage to get this code to execute pruning only that is :)

from channel-pruning.

@slothkong This is a similar method and question.
https://github.com/chengtaipu/lowrankcnn/blob/master/imagenet/models_vgg/config.json

from channel-pruning.

@makitann , I just found this:
https://github.com/yihui-he/channel-pruning/blob/3a4614de8c11aeb2ab981ddc619927c0e60a6577/lib/net.py#L1505-L1507
(ㅇㅅㅇ)

from channel-pruning.

@slothkong Sorry, last week was a busy week.
It looks like that it's meant to be hide something ....

from channel-pruning.

Determining rank is out of our paper's scope.
Ranks are manually set.
In channel decomposition, there's a heuristic method proposed.

from channel-pruning.