QuantReLU scale factors about brevitas HOT 2 CLOSED

So is scaling_per_output_channel in QuantReLU by default True, or False? And when it's False, then there is one scale factor per tensor?

The default quantizer used by QuantReLU has scaling_per_output_channel set to False.

And the reasoning behind having scaling_per_output_channel=True after the first layer in MobileNetV1 and scaling_per_output_channel=False in ProxylessNAS Mobile14 is arbitrary?

They were made considering certain trade-offs in terms of accuracy, hardware constraints, etc. These constraints might be different between users.

Also related question, what is the role of per_channel_broadcastable_shape and scaling_stats_permute_dims? I couldn't find anything about it and it is in some examples and in some it's not.

We are going to expand our notebooks with some explanations about this.

from brevitas.

We are working on a PR to expand the explanation about per channel scale factors with activations.
#867

I am closing this issue, but feel free to re-open in case there are further questions.

from brevitas.