Git Product home page Git Product logo

gghl-deployment's Introduction

GGHL-Deployment

初步计划实现对以下平台的推理,分别是

  • NCNN(完成)
  • openvino(无AVX512)
  • tensorrt(实现)
  • onnxruntime(python API)

TensorRT

  • FP-16 load image 16.32ms
  • FP-16 nms 48.32ms
  • FP-16 inference 5ms

NCNN

  • PNNX(转换已完成)
  • 推理已完成
  • 解码完成 image

更新

我们发现有些情况中,onnx->trt转换时会出现段错误的情况,解决的方式是使用英伟达官方的 转换工具\trtexec,通过分配尽可能的maxworkspace来减少这种情况的出现

命令行解析的支持

GGHL-Deployment 命令行解析的支持,目前您可以指定输入的图片,来获取解析后图片的表征图片

  • 引擎文件的选择
  • 精度的选择
  • 解耦模式的选择

解耦头

原版的GGHL是有解耦头,直接省略了cpp后端的解码的过程,但是由于ScatterNd以及过多的算子影响了GGHL在不同框架的推广范围,我们更新了新的部署的方式,在原有的基础上,我们可以在不重新训练模型的基础上实现旋转框的解译

   decode_infer(original_result, grid,convert_middle);
   // convert_result(original_result,convert_middle);

利用的decode_infer原来的convert_result,实现解耦头的推理。

gghl-deployment's People

Contributors

crescent-ao avatar

Stargazers

 avatar Ji Zhuangzhi avatar fanjing8 avatar  avatar  avatar  avatar DS.Xu avatar  avatar codeplay avatar  avatar  avatar  avatar  avatar WoodenPig avatar 许皓 avatar 锦青 avatar Jiayong avatar xum avatar  avatar haohao avatar KangChou~OvO⁹⁹ avatar  avatar CANOE avatar Zhanchao Huang avatar

Watchers

 avatar  avatar

gghl-deployment's Issues

model

能提供一下模型吗?

关于推理时间

您好,请问推理时间5ms是在什么平台上实现的?是Nvidia AGX上吗?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.