Git Product home page Git Product logo

OpenVINO-TensorRT-Benchmarking

Convert and Benchmark InceptionV3, 2D U-Net Tensorflow/Keras models to OpenVINO and TensorRT.

This repo contains notebooks to replicate benchmarking with OpenVINO and TensorRT.

OpenVINO Benchmarking with Docker

To re-run benchmarks with OpenVINO, the simple way is to run with a docker.

Step 1: Install Docker on Ubuntu:

curl -fsSL https://get.docker.com -o get-docker.sh &&
sudo sh get-docker.sh && 
sudo usermod -aG docker $USER

Step 2: Run benchmarks

To run both Inceptionv3 and 2D U-Net benchmark

docker run --rm rpanchum/ovbench:latest /root/bench.sh

To run Inceptionv3 benchmark

docker run --rm rpanchum/ovbench:latest /root/bench_inceptionv3.sh

To run 2D U-Net benchmark:

docker run --rm rpanchum/ovbench:latest /root/bench_unet.sh

Ravi Panchumarthy's Projects

azure-hc-intel-tf icon azure-hc-intel-tf

Setup Azure HC-series to run deep learning distributed training with intel-tensorflow and Horovod

base_docker icon base_docker

Base docker image to use to build codespaces during tutorials

brainmage icon brainmage

Brain extraction in presence of abnormalities, using single and multiple MRI modalities

craft-pytorch icon craft-pytorch

Official implementation of Character Region Awareness for Text Detection (CRAFT)

deepmedic icon deepmedic

Efficient Multi-Scale 3D Convolutional Neural Network for Brain Lesion Segmentation

faultseg icon faultseg

Using synthetic datasets to train an end-to-end CNN for 3D fault segmentation (We are working on an improved version!)

model_server icon model_server

A scalable inference server for models optimized with OpenVINO™

openvino-demos icon openvino-demos

This repo contains information regarding cloud offerings of OpenVINO™ and demos to showcase OpenVINO™ via sample Jupyter notebooks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.