Scalable TensorFlow inference system with TensorRT and Tesla T4
This is not an official Google product.
The repository maintains scripts and configuration files which are used to launch a scalable TensorFlow inference system on Google Kubernates Engine by leveraging NVIDIA technologies such as TensorRT, TRTIS and Tesla T4 GPU.
Note: Some files in this repository reference to one or more terms that Google considers disrespectful or offensive. The terms are used because they are keywords in the software that's configured with those files.