lix19937/tensorrt-insight

[runner.cpp::execute::718] Error Code 1: Myelin (Final synchronize failed (700))

lix19937 opened this issue · 1 comments

open cuda graph

[07/10/2024-14:43:02] [I] Starting inference
[07/10/2024-14:43:02] [E] Error[1]: [runner.cpp::execute::718] Error Code 1: Myelin (Final synchronize failed (700))

trtexec: samples/common/sampleInference.cpp:844: void sample::
{anonymous}::Iteration<ContextType>::createEnqueueFunction(const sample::InferenceOptions&, 
nvinfer1::IExecutionContext&, sample::Bindings&) [with ContextType = nvinfer1::IExecutionContext]: 
Assertion `ret' failed.

if close cuda graph,

[07/10/2024-14:58:12] [V] Using enqueueV3.
[07/10/2024-14:58:12] [I] Using random values for input img
[07/10/2024-14:58:12] [I] Created input binding for img with dimensions 6x3x640x1600
[07/10/2024-14:58:12] [I] Using random values for input onnx::Reshape_1
[07/10/2024-14:58:12] [I] Created input binding for onnx::Reshape_1 with dimensions 1x6x4x4
[07/10/2024-14:58:12] [I] Using random values for input onnx::Reshape_3
[07/10/2024-14:58:13] [I] Created input binding for onnx::Reshape_3 with dimensions 1x40000x256
[07/10/2024-14:58:13] [I] Using random values for output v.3
[07/10/2024-14:58:13] [I] Created output binding for v.3 with dimensions 40000x1x256
[07/10/2024-14:58:13] [I] Using random values for output 6064
[07/10/2024-14:58:13] [I] Created output binding for 6064 with dimensions 3x1x300x6
[07/10/2024-14:58:13] [I] Using random values for output 6071
[07/10/2024-14:58:13] [I] Created output binding for 6071 with dimensions 3x1x300x10
[07/10/2024-14:58:13] [I] Starting inference
[07/10/2024-14:58:13] [E] Error[1]: [runner.cpp::execute::718] Error Code 1: Myelin (Final synchronize failed (700))
Cuda failure: an illegal memory access was encountered
Aborted