yester31 / real_esrgan_trt Goto Github PK

View Code? Open in Web Editor NEW

17.0 17.0 6.0 717 KB

Real ESRGAN Optimization Using by TensorRT API, linux

CMake 2.24% C++ 83.19% Python 7.88% C 0.86% Cuda 5.83%

cuda esrgan super-resolution tensorrt

real_esrgan_trt's Introduction

Hi there 👋

I am Deep Learning Programmer

interest

Model optimization
- Knowledge Distillation
- Pruning
- Quantization (ptq, qat)
Parallel Programming
- CUDA
- SIMD

Language

C/C++, CUDA, OpenCL, Python, Rust, Javascript, Java, C#, OpenMP

Deep Learning Framework

Pytorch, TensorFlow, Darknet, Cudnn, TensorRT, OpenVINO, OneDNN, Onnx runtime, Aparch TVM

Other Skills

Web, WebSocket, WebRTC, Nodejs, Django, MySQL, Anaconda, git, github, docker, Make, CMake, Nvidia edge device(jetson series, drive orin ...)

Linkedin & Blog

to do list

real_esrgan_trt's People

Contributors

Stargazers

Watchers

Forkers

tangohu17 xyt2008 barrypp zhangsanfeng86 czha8903 phineas-pta

real_esrgan_trt's Issues

encounter an error while serializing model to plan file on Windows 10.

Hi, thanks for sharing this project.
I'm trying to complete this project on Windows 10 with ide Visual Studio 2019, so I change some contents of the CmakeLists.txt,

cmake_minimum_required(VERSION 2.6)

project(real-esrgan) #1
set(OpenCV_DIR "D:\\opencv\\build")  #2
set(OpenCV_INCLUDE_DIRS ${OpenCV_DIR}\\include) #3
set(OpenCV_LIB_DIRS ${OpenCV_DIR}\\x64\\vc15\\lib) #4
set(OpenCV_Debug_LIBS "opencv_world450d.lib") #5
set(OpenCV_Release_LIBS "opencv_world450.lib") #6
set(TRT_DIR "D:\\TensorRT-8.2.4.2")  #7
set(TRT_INCLUDE_DIRS ${TRT_DIR}\\include) #8
set(TRT_LIB_DIRS ${TRT_DIR}\\lib) #9
set(Dirent_INCLUDE_DIRS "D:\\dirent\\include") #10

add_definitions(-std=c++11)

set(CUDA_BIN_PATH C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v11.6)
option(CUDA_USE_STATIC_CUDA_RUNTIME OFF)
set(CMAKE_CXX_STANDARD 11)
set(CMAKE_BUILD_TYPE Debug)

set(THREADS_PREFER_PTHREAD_FLAG ON)
find_package(Threads)

# setup CUDA
find_package(CUDA REQUIRED)
message(STATUS "    libraries: ${CUDA_LIBRARIES}")
message(STATUS "    include path: ${CUDA_INCLUDE_DIRS}")

include_directories(${CUDA_INCLUDE_DIRS})

set(CUDA_NVCC_PLAGS ${CUDA_NVCC_PLAGS};-std=c++11; -g; -G;-gencode; arch=compute_75;code=sm_75)
####
enable_language(CUDA)  # add this line, then no need to setup Cuda path in vs
####
include_directories(${PROJECT_SOURCE_DIR}/include) #11
include_directories(${TRT_INCLUDE_DIRS}) #12
link_directories(${TRT_LIB_DIRS}) #13
include_directories(${OpenCV_INCLUDE_DIRS}) #14
link_directories(${OpenCV_LIB_DIRS}) #15
include_directories(${Dirent_INCLUDE_DIRS}) #16


# -D_MWAITXINTRIN_H_INCLUDED for solving error: identifier "__builtin_ia32_mwaitx" is undefined
set(CMAKE_CXX_FLAGS "${CMAKE_CXX_FLAGS} -std=c++11 -Wall -Ofast -D_MWAITXINTRIN_H_INCLUDED")

# setup opencv
find_package(OpenCV QUIET
    NO_MODULE
    NO_DEFAULT_PATH
    NO_CMAKE_PATH
    NO_CMAKE_ENVIRONMENT_PATH
    NO_SYSTEM_ENVIRONMENT_PATH
    NO_CMAKE_PACKAGE_REGISTRY
    NO_CMAKE_BUILDS_PATH
    NO_CMAKE_SYSTEM_PATH
    NO_CMAKE_SYSTEM_PACKAGE_REGISTRY
)

message(STATUS "OpenCV library status:")
message(STATUS "    version: ${OpenCV_VERSION}")
message(STATUS "    lib path: ${OpenCV_LIB_DIRS}")
message(STATUS "    Debug libraries: ${OpenCV_Debug_LIBS}")
message(STATUS "    Release libraries: ${OpenCV_Release_LIBS}")
message(STATUS "    include path: ${OpenCV_INCLUDE_DIRS}")



add_executable(real-esrgan ${PROJECT_SOURCE_DIR}/real-esrgan.cpp ${PROJECT_SOURCE_DIR}/common.hpp 
	${PROJECT_SOURCE_DIR}/preprocess.cu ${PROJECT_SOURCE_DIR}/preprocess.hpp
	${PROJECT_SOURCE_DIR}/postprocess.cu ${PROJECT_SOURCE_DIR}/postprocess.hpp
	)   #17

target_link_libraries(real-esrgan "nvinfer" "nvinfer_plugin") #18
target_link_libraries(real-esrgan debug ${OpenCV_Debug_LIBS}) #19
target_link_libraries(real-esrgan optimized ${OpenCV_Release_LIBS}) #20
target_link_libraries(real-esrgan ${CUDA_LIBRARIES}) #21
target_link_libraries(real-esrgan Threads::Threads)

and it's ok to execute commands 'cmake .. && make '.
However, I encounter an error while serializing model to plan file after executing ' ./real-esrgan -s ./real-esrgan.wts ./real-esrgan_f32.engine ',
[06/08/2022-11:05:57] [E] [TRT] 2: [builder.cpp::nvinfer1::builder::createCaskKernelLibraryImpl::133] Error Code 2: Internal Error (Assertion validateCaskKLibDigest(sha256sum) failed. )
.

how to change to win10?

Performance and compatibility

@yester31 Good job!

what video card do you use in your test environment, and how about performance, are all models supported?

Thanks!

Help ! about image size

Thanks for your Enlightening job with Real-ESRGAN.

I can build engine and infer _OST_009.png (the size is 448x640).

However, for other size, such as 179 x179, the infer output is really Confusing. Sometime encounter Segment fault.

can the image size only be 448x640 ?

have a good day!

problem in Real-ESRGAN

use trt7 or trt8?
in CMakeLists.txt line 17 -->include_directories(${PROJECT_SOURCE_DIR}/include)
there is no include fold.
thanks.

How to use 2x model for inference？

Thanks for your great work.
We want to use a 2x model for inference, but we need to add a pixelunshuffle operation. We try to add it before preprocessing, but find that the results are not correct. Can you give me some advice?

Error when creating 16fp engine in windows for large images

Env

GPU: GeForce GTX 1660
OS: Windows 10
Cuda version: 11.3
TensorRT version: 8.2.5

Problem

When creating 16fp engine in windows for large images (such 1220*900), the error shown in the image occurs. In ubuntu, there is no such error. My .wts file is created from realesragan_x2plus model.

Error Code 3: API Usage Error (Parameter check failed at: optimiz er/api/builder.cpp::~Builder::336, condition: mObjectCounter.use_count() == 1. Destroying a builder object before destroying obje cts it created leads to undefined behavior.

./real-esrgan -s real-esrgan.wts real-esrgan.engine
Hello, thank you for your script. I encountered an issue while using it. Could you please advise me on how to solve it? Thank you very much. I would also like to ask if the versions of RT and cuDNN would affect the results?

[05/15/2023-10:08:07] [W] [TRT] CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage and sp
eed up TensorRT initialization. See "Lazy Loading" section of CUDA documentation https://docs.nvidia.com/cuda/cuda-c-programming-
guide/index.html#lazy-loading              
[05/15/2023-10:08:07] [W] [TRT] The implicit batch dimension mode has been deprecated. Please create the network with NetworkDefi
nitionCreationFlag::kEXPLICIT_BATCH flag whenever possible.
Loading weights: real-esrgan.wts                                                           
==== precision f32 ====                                                                                                          
                                                                                                                                 
Building engine, please wait for a while...
[05/15/2023-10:08:09] [W] [TRT] TensorRT was linked against cuDNN 8.8.0 but loaded cuDNN 8.1.1                                   
[05/15/2023-10:09:42] [W] [TRT] TensorRT was linked against cuDNN 8.8.0 but loaded cuDNN 8.1.1
Build engine successfully!
[05/15/2023-10:09:42] [E] [TRT] 3: [builder.cpp::~Builder::336] Error Code 3: API Usage Error (Parameter check failed at: optimiz
er/api/builder.cpp::~Builder::336, condition: mObjectCounter.use_count() == 1. Destroying a builder object before destroying obje
cts it created leads to undefined behavior.
)

CMakeLists.txt for win10

Can you give a CMakeLists.txt for win10, thanks

can you update real_esrgan_trt?

can you update real_esrgan_trt?
according to
https://github.com/ai-forever/Real-ESRGAN
its efforts are better than the original repository (https://github.com/xinntao/Real-ESRGAN)

thanks

conversion error with RealESRGAN_x4plus_anime_6B

environment:

windows 11
visual studio 17 2022 (cmake 3.26.4, msbuild 17.7.2)
cuda 12.1
cudnn 8.9.5
tensorrt 8.6.1.6

using this repo https://github.com/wang-xinyu/tensorrtx/tree/master/real-esrgan

i successfully build RealESRGAN_x4plus and RealESRNet_x4plus

but with RealESRGAN_x4plus_anime_6B i got error when convert .wts to .engine

error message

[10/14/2023-15:37:24] [E] [TRT] 4: [convolutionNode.cpp::nvinfer1::builder::ConvolutionNode::computeOutputExtents::58] Error Code 4: Internal Error ((Unnamed Layer* 284) [Convolution]: number of kernel weights does not match tensor dimensions)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 298) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 298) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 298) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 313) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 313) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 313) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 330) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 330) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 330) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 345) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 345) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 345) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 360) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 360) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 360) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 377) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 377) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 377) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 392) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 392) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 392) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 407) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 407) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 407) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 424) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 424) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 424) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 439) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 439) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 439) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 454) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 454) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 454) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 471) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 471) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 471) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 486) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 486) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 486) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 501) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 501) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 501) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 518) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 518) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 518) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 533) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 533) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 533) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 548) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 548) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 548) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 565) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 565) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 565) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 580) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 580) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 580) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 595) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 595) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 595) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 612) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 612) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 612) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 627) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 627) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 627) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 642) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 642) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 642) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 659) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 659) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 659) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 674) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 674) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 674) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 689) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 689) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 689) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 706) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 706) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 706) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 721) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 721) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 721) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 736) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 736) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 736) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 753) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 753) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 753) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 768) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 768) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 768) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 783) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 783) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 783) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 800) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 800) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 800) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 815) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 815) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 815) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 830) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 830) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 830) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 847) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 847) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 847) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 862) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 862) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 862) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 877) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 877) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 877) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 894) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 894) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 894) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 909) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 909) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 909) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 924) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 924) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 924) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 941) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 941) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 941) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 956) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 956) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 956) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 971) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 971) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 971) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 988) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 988) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 988) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1003) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1003) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1003) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1018) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1018) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1018) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1035) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1035) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1035) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1050) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1050) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1050) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1065) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1065) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 4: [graphShapeAnalyzer.cpp::nvinfer1::builder::`anonymous-namespace'::ShapeAnalyzerImpl::needTypeAndDimensions::2212] Error Code 4: Internal Error ((Unnamed Layer* 1065) [ElementWise]: output shape can not be computed)
[10/14/2023-15:37:24] [E] [TRT] 3: [network.cpp::nvinfer1::Network::addResize::1421] Error Code 3: API Usage Error (Parameter check failed at: network.cpp::nvinfer1::Network::addResize::1421, condition: input.getDimensions().nbDims > 0

any patch possible like the x2 model ?

thanks

Real-Esrgan does not work with dimensions other than the default size

Env

GPU: GeForce GTX 1660
OS: Ubuntu 20.04
Cuda version: 11.4
TensorRT version: 8

About this repo

which model? real-esrgan

Your problem

I ran this code from https://github.com/wang-xinyu/tensorrtx/ as well as your repository, and the problem is that Real-Esrgan does not work with dimensions other than the default size of 448 * 640 (width * height), despite of changing corresponding lines in real-esrgan.cpp:

static const int INPUT_H = 640;
static const int INPUT_W = 448;

This is the result of default size (448*640):
https://drive.google.com/file/d/1ugByr7dNU760DD7pjdx_90Z9y0SzJcub/view?usp=sharing

and this is the result of image with size of 455*680 and changing corresponding lines in real-esrgan.cpp:
https://drive.google.com/file/d/1wE7Y3stM6dxs4Zlj2fuNBdDnLB45ixyH/view?usp=sharing

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.