batch inference about easy_vitpose HOT 2 CLOSED

Hello, batched inference is not implemented and is on the TODO list.
It should be straightforward using torch checkpoints but might require some more engineering using tensorrt and onnx.

The postprocessing to extract the coordinates from heatmaps should work right away, you can find it here.

I would be interested to merge a batched inference version if the performance gain is noticeable.
If you want to work on this I can provide you feedback and help. I would start by adapting the onnx models because the trt inference is more complex. Check the notebook used to export the models link and try to run inference on a batched input, it should have dynamic batch size already enabled.
Once it works check the other notebook to_trt.ipynb that exports the trt models from the onnx ones. The export function and inference engine must be adapted to accept arbitrary batch sizes.

If you manage to run the models on batches we can later adapt the code to also run batched pre/post processing and bbox extraction.

from easy_vitpose.

Closing for inactivity, feel free to reopen

from easy_vitpose.