The motivation to crete this repo is to get a minimal deeplearning model running on Triton with onnxruntime backend.
$ python3 -m venv .
$ ./venv/bin.activate
$ pip install -r requirements.txt
## Installation/ Build
$ podman-compose up --build
## Run tests
$ podman-compose run --rm build python -m unittest
## Start
$ podman-compose up
url: http://localhost:8080/docs
This would create a tensorflow model in source dir. Also, we would see minimal deeplearning tf model predict fashion minist. File: image_classification.py
$ python -m tf2onnx.convert --saved-model ./model --opset 15 --output model.onnx
Loads onnx model and uses onnxruntime to predict File: image_classification_onnx.py
Triton Config: triton_model_repository