Git Product home page Git Product logo

deepstream-openpose's Introduction

deepstream-openpose

1. Run CMU pose demo

Platform: xavier, Jetpack 4.3 with DeepStream 4.0.2

Notes:

  1. Porting to Tesla/x86 platform should be easy.
  2. CUDA_cublas_device_LIBRARY NOTFOUND issue -> Solution
  3. Refer to openpose/scripts/ubuntu/install_deps.sh to install deps libs.
  4. Refer to openpose/models/getModels.sh to fetch models
  5. Build.
    $ cmake -D CMAKE_BUILD_TYPE=Debug ..
    $ make -j4
    
  6. These demos can work.
    $ ./build/examples/openpose/openpose.bin
    $ ./build/examples/tutorial_api_cpp/01_body_from_image_default.bin
    $ ...
    

It show like this.

2. Deploy pose coco model by DeepStream 4.0.2

Model: pose/coco/pose_iter_440000.caffemodel, pose/coco/pose_deploy_linevec.prototxt

Pipeline:

filesrc -> jpegparse -> nvv4l2decoder -> nvstreammux -> nvinfer (openpose and 18 parts parse) nvsegvidsual -> nvmultistreamtiler -> (nvegltransform) -> nveglglessink

Build libnvds_infer.so

$ cd libs/nvinfer
$ make
Backup /opt/nvidia/deepstream/deepstream-4.0/lib/libnvds_infer.so
$ sudo ln -sf $(pwd)/libnvds_infer.so /opt/nvidia/deepstream/deepstream-4.0/lib/libnvds_infer.so 

Build openpose-app

$ cd openpose_app
$ make
Change nvinfer_config.txt "model-file" and "proto-file" to be your path
 model-file=
 proto-file=

Run

$ ./openpose-app ./nvinfer_config.txt COCO_val2014_000000000564.jpg

3. TODO

Add dsexample plugin after nvinfer and do resize_merge, nms and BodyPartConnector, and show result by nvosd like the below.

deepstream-openpose's People

Contributors

cding-nv avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.