iwatake2222/play_with_tensorrt

yolov7 error while convertting (yolov7_736x1280.onnx to TensorRT engine) in ./main

Closed this issue · 3 comments

pipidx commented

Environment (Hardware)

----------Docker tensorrt:21.10-py3-----------

--------Docker Ubuntu OS-----------------------
Distributor ID: Ubuntu
Description: Ubuntu 20.04.3 LTS
Release: 20.04
Codename: focal

--------Docker CUDA----------------
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2021 NVIDIA Corporation
Built on Sun_Aug_15_21:14:11_PDT_2021
Cuda compilation tools, release 11.4, V11.4.120
Build cuda_11.4.r11.4/compiler.30300941_0

-------Local Running PC to run docker------
CUDA 11.4
Ubuntu 18.04
GPU RTX 3070Ti

Project Name

pj_tensorrt_det_yolov7

Issue Details

I'm trying to run ./main from pj_tensorrt_det_yolov7 after successfully built.
But while converting onnx to tensorrt engine, the error occurs

How to Reproduce

Steps to reproduce the behavior. Please include your cmake command.
(detector) root@001ff98c0213:/workspace/play_with_tensorrt/pj_tensorrt_det_yolov7/build# cmake ..
-- The C compiler identification is GNU 9.4.0
-- The CXX compiler identification is GNU 9.4.0
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
[main] CMAKE_SYSTEM_PROCESSOR = x86_64, BUILD_SYSTEM = x64_linux
-- No build type selected, default to Release
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP_CXX: -fopenmp (found version "4.5")
-- Found OpenMP: TRUE (found version "4.5")
-- Found OpenCV: /usr (found version "4.2.0")
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - found
-- Found Threads: TRUE
-- Found CUDA: /usr/local/cuda (found version "11.4")
CUDA_INCLUDE_DIRS: /usr/local/cuda/include
-- Configuring done
-- Generating done
-- Build files have been written to: /workspace/play_with_tensorrt/pj_tensorrt_det_yolov7/build

|||| Make ||||

(detector) root@001ff98c0213:/workspace/play_with_tensorrt/pj_tensorrt_det_yolov7/build# make
Scanning dependencies of target InferenceHelper
[ 7%] Building CXX object image_processor/inference_helper/CMakeFiles/InferenceHelper.dir/inference_helper.cpp.o
[ 14%] Building CXX object image_processor/inference_helper/CMakeFiles/InferenceHelper.dir/inference_helper_tensorrt.cpp.o
[ 21%] Building CXX object image_processor/inference_helper/CMakeFiles/InferenceHelper.dir/tensorrt/logger.cpp.o
[ 28%] Linking CXX static library libInferenceHelper.a
[ 28%] Built target InferenceHelper
Scanning dependencies of target CommonHelper
[ 35%] Building CXX object image_processor/common_helper/CMakeFiles/CommonHelper.dir/common_helper.cpp.o
[ 42%] Building CXX object image_processor/common_helper/CMakeFiles/CommonHelper.dir/bounding_box.cpp.o
[ 50%] Building CXX object image_processor/common_helper/CMakeFiles/CommonHelper.dir/tracker.cpp.o
[ 57%] Building CXX object image_processor/common_helper/CMakeFiles/CommonHelper.dir/common_helper_cv.cpp.o
[ 64%] Linking CXX static library libCommonHelper.a
[ 64%] Built target CommonHelper
Scanning dependencies of target ImageProcessor
[ 71%] Building CXX object image_processor/CMakeFiles/ImageProcessor.dir/image_processor.cpp.o
[ 78%] Building CXX object image_processor/CMakeFiles/ImageProcessor.dir/detection_engine.cpp.o
[ 85%] Linking CXX static library libImageProcessor.a
[ 85%] Built target ImageProcessor
Scanning dependencies of target main
[ 92%] Building CXX object CMakeFiles/main.dir/main.cpp.o
[100%] Linking CXX executable main
[100%] Built target main

Error Log

the error log while i'm trying to run ./main
(detector) root@001ff98c0213:/workspace/play_with_tensorrt/pj_tensorrt_det_yolov7/build# ./main

[InferenceHelper][117] Use TensorRT 
[02/08/2023-09:48:03] [I] [TRT] [MemUsageChange] Init CUDA: CPU +537, GPU +0, now: CPU 548, GPU 1145 (MiB)
[02/08/2023-09:48:04] [I] [TRT] Loaded engine size: 95 MB
[02/08/2023-09:48:04] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine begin: CPU 668 MiB, GPU 1145 MiB
[02/08/2023-09:48:05] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +793, GPU +340, now: CPU 1478, GPU 1567 (MiB)
[02/08/2023-09:48:06] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +198, GPU +342, now: CPU 1676, GPU 1909 (MiB)
[02/08/2023-09:48:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1676, GPU 1891 (MiB)
[02/08/2023-09:48:06] [I] [TRT] [MemUsageSnapshot] deserializeCudaEngine end: CPU 1676 MiB, GPU 1891 MiB
[02/08/2023-09:48:06] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation begin: CPU 1556 MiB, GPU 1891 MiB
[02/08/2023-09:48:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +10, now: CPU 1556, GPU 1901 (MiB)
[02/08/2023-09:48:06] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +8, now: CPU 1556, GPU 1909 (MiB)
[02/08/2023-09:48:06] [I] [TRT] [MemUsageSnapshot] ExecutionContext creation end: CPU 1556 MiB, GPU 2119 MiB
[InferenceHelperTensorRt][345] num_of_in_out = 2
[InferenceHelperTensorRt][348] tensor[0]->name: images
[InferenceHelperTensorRt][349]   is input = 1
[InferenceHelperTensorRt][353]   dims.d[0] = 1
[InferenceHelperTensorRt][353]   dims.d[1] = 3
[InferenceHelperTensorRt][353]   dims.d[2] = 736
[InferenceHelperTensorRt][353]   dims.d[3] = 1280
[InferenceHelperTensorRt][357]   data_type = 0
[InferenceHelperTensorRt][348] tensor[1]->name: output
[InferenceHelperTensorRt][349]   is input = 0
[InferenceHelperTensorRt][353]   dims.d[0] = 1
[InferenceHelperTensorRt][353]   dims.d[1] = 57960
[InferenceHelperTensorRt][353]   dims.d[2] = 85
[InferenceHelperTensorRt][357]   data_type = 0
Unable to init server: Could not connect: Connection refused

(test:7748): Gtk-WARNING **: 09:48:06.055: cannot open display: 
[02/08/2023-09:48:06] [E] [TRT] 1: [hardwareContext.cpp::terminateCommonContext::141] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [defaultAllocator.cpp::free::85] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [W] [TRT] Unable to determine GPU memory usage
[02/08/2023-09:48:06] [W] [TRT] Unable to determine GPU memory usage
[02/08/2023-09:48:06] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1392, GPU 0 (MiB)
[02/08/2023-09:48:06] [F] [TRT] [defaultAllocator.cpp::free::85] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaStream::455] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.cpp::~ScopedCudaEvent::438] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [defaultAllocator.cpp::free::85] Error Code 1: Cuda Runtime (driver shutting down)
[02/08/2023-09:48:06] [F] [TRT] [resources.h::operator()::445] Error Code 1: Cuda Driver (TensorRT internal error)
Segmentation fault (core dumped)

Additional Information

Add any other context about the problem here.

iwatake2222 commented

I just tested the project in my native Ubuntu 22.04 + CUDA 11.7 + TensorRT8.2.4, and it works (both model conversion and detection)
I wonder if you installed CUDA + TensorRT appropriately.
Did you check the followings?

  • Test another simple project like pj_tensorrt_cls_mobilenet_v2
  • Test NVIDIA official sample inference code

If they don't work, I recommend you check your environment. For instance, you may need to set LD_LIBRARY_PATH

pipidx commented

Thank you, I will try it again.

pipidx commented

Thanks again, it's working now on both my native Ubuntu as well as Jetson Xavier NX.