Has anyone tried converting a SAR model from onnx to tensorrt format? about mmdeploy HOT 6 CLOSED

Hi, check it out that we only support exporting SARNet to onnx.

from mmdeploy.

Yes, it was well said in the site. I wonder what make it difficult to do a onnx2tensorrt conversion in SARNet. Could you provide any related posts or specs on this matter? Thank you in advance.

from mmdeploy.

Well, the SARNet trained for Chinese characters is larger than 2GB making it nearly impossible to be converted to TensorRT. That's why we don't support it for other backends.

However, for the error log provided above, it is highly likely that changing the version of TensorRT can avoid the error.

from mmdeploy.

Thanks for your commment. I see, the SARNET I trained only has 800MB in onnx format, would it be possible to do a conversion via onnx2tensorrt? And is there a model capacity/volume estimation that a conversion from the torch format to tenorRT's impossible or infeasible in the mmdeploy framework?

from mmdeploy.

First question, basically yes but not quite sure. The second question, size limitation of a single file comes from onnx itself.

from mmdeploy.

OK, thank you.

from mmdeploy.