lavieenrosesmz / oqa Goto Github PK

Thanks for sharing the awesome work!
I have one question about quantization function and bit inheritance.
In the paper, you choose LSQ as the quantization function which has a learnable scale paremeter and double the paremeter when bit-width goes down(bit inheritance).
My question is:
If using google's tflite int16/in8 quantization function which has a scale and a zero point, does your OQA algoritim work？If it works, how should I adjust the bit inheritance algorithm？

Thanks!

Hi,
Thanks for sharing the awesome work! Could you share the training code of 4/3/2 bit OQA if you can? Thanks a lot!

Hi,

Thanks for sharing the exciting work! Two quick questions about the H-swish activation and the SE layer.

H-swish activation is troublesome because of its skewed distribution. Specifically for LSQ, we either use an unsigned quantizer and clip all negative values to zero or use a signed quantizer and waste some of the negative quantization grid. Judging from your implementation of LSQ, you took the former route. Did you observe any impact on performance from clipping the activation?

For the SE layer, I see you left it at full precision. Have you tried to quantize it? If so, how much does it impact the performance?

Thank you!