Git Product home page Git Product logo

deeplearningexamples's Introduction

NVIDIA Deep Learning Examples for Tensor Cores

Introduction

This repository provides State-of-the-Art Deep Learning examples that are easy to train and deploy, achieving the best reproducible convergence and performance with NVIDIA CUDA-X software stack running on NVIDIA Volta, Turing and Ampere GPUs.

NVIDIA GPU Cloud (NGC) Container Registry

These examples, along with our NVIDIA deep learning software stack, are provided in a monthly updated Docker container on the NGC container registry (https://ngc.nvidia.com). These containers include:

  • The latest NVIDIA examples from this repository
  • The latest NVIDIA contributions shared upstream to the respective framework
  • The latest NVIDIA Deep Learning software libraries, such as cuDNN, NCCL, cuBLAS, etc. which have all been through a rigorous monthly quality assurance process to ensure that they provide the best possible performance
  • Monthly release notes for each of the NVIDIA optimized containers

Computer Vision

Models Framework DALI AMP Multi-GPU Multi-Node TensorRT ONNX Triton TF-TRT Notebook
Computer Vision
ResNet-50 v1.5 PyTorch Yes Yes Yes - - - - - -
ResNeXt101-32x4d PyTorch Yes Yes Yes - - - - - -
SE-ResNeXt101-32x4d PyTorch Yes Yes Yes - - - - - -
Mask R-CNN PyTorch N/A Yes Yes - - - - - Yes
SSD300 v1.1 PyTorch Yes Yes Yes - - - - - Yes
ResNet-50 v1.5 TensorFlow Yes Yes Yes - - - - - -
ResNeXt101-32x4d TensorFlow Yes Yes Yes - - - - - -
SE-ResNeXt101-32x4d TensorFlow Yes Yes Yes - - - - - -
Mask R-CNN TensorFlow N/A Yes Yes - - - - - -
SSD320 v1.2 TensorFlow N/A Yes Yes - - - - - Yes
U-Net Industrial TensorFlow N/A Yes Yes - Yes - - Yes Yes
U-Net Medical TensorFlow N/A Yes Yes - Yes - - Yes -
V-Net Medical TensorFlow N/A Yes Yes - Yes Yes - Yes -
U-Net Medical TensorFlow-2 N/A Yes Yes - Yes - - Yes -
Mask R-CNN TensorFlow-2 N/A Yes Yes - - - - - -
ResNet50 v1.5 MXNet Yes Yes Yes - - - - - -

Natural Language Processing

Models Framework DALI AMP Multi-GPU Multi-Node TensorRT ONNX Triton TF-TRT Notebook
BERT PyTorch N/A Yes Yes Yes - - Yes - -
Transformer-XL PyTorch N/A Yes Yes Yes - - - - -
GNMT v2 PyTorch N/A Yes Yes - - - - - -
Transformer PyTorch N/A Yes Yes - - - - - -
BERT TensorFlow N/A Yes Yes Yes Yes - Yes Yes Yes
BioBert TensorFlow N/A Yes Yes - - - - - Yes
Transformer-XL TensorFlow N/A Yes Yes - - - - - -
GNMT v2 TensorFlow N/A Yes Yes - - - - - -
Faster Transformer Tensorflow N/A - - - Yes - - - -
Transformer-XL TensorFlow N/A Yes Yes - - - - - -

Recommender Systems

Models Framework DALI AMP Multi-GPU Multi-Node TensorRT ONNX Triton TF-TRT Notebook
DLRM PyTorch N/A Yes Yes - - Yes Yes - Yes
Neural Collaborative Filtering PyTorch N/A Yes Yes - - - - - -
Wide and Deep TensorFlow N/A Yes Yes - - - - - -
Neural Collaborative Filtering TensorFlow N/A Yes Yes - - - - - -
Variational Autoencoder Collaborative Filtering TensorFlow N/A Yes Yes - - - - - -

Speech to Text

Models Framework DALI AMP Multi-GPU Multi-Node TensorRT ONNX Triton TF-TRT Notebook
Jasper PyTorch N/A Yes Yes - Yes Yes Yes - Yes
HMM Kaldi N/A - Yes - - - Yes - -

Text to Speech

Models Framework DALI AMP Multi-GPU Multi-Node TensorRT ONNX Triton TF-TRT Notebook
Tacotron 2 and WaveGlow PyTorch N/A Yes Yes - Yes Yes Yes - -
FastPitch PyTorch N/A Yes Yes - - - - - -

NVIDIA support

In each of the network READMEs, we indicate the level of support that will be provided. The range is from ongoing updates and improvements to a point-in-time release for thought leadership.

Feedback / Contributions

We're posting these examples on GitHub to better support the community, facilitate feedback, as well as collect and implement contributions using GitHub Issues and pull requests. We welcome all contributions!

Known issues

In each of the network READMEs, we indicate any known issues and encourage the community to provide feedback.

deeplearningexamples's People

Contributors

nvpstr avatar grzegorz-k-karch avatar nv-kkudrynski avatar sharathts avatar byshiue avatar swethmandava avatar yzhang123 avatar jconwaynv avatar maggiezha avatar rajeevsrao avatar khcs avatar szmigacz avatar pribalta avatar vinhngx avatar cliffwoolley avatar nvcforster avatar irishcoffee avatar jbaczek avatar tgrel avatar skierat avatar t-kusanagi avatar dependabot[bot] avatar trentlo avatar nluehr avatar mmarcinkiewicz avatar moconnor725 avatar lapolonio avatar khoa-ho avatar eric-haibin-lin avatar zhiqwang avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.