string device = "cuda";//cuda测试失败

[FuShengRuoXian]

控制台信息：
CUDAExecutionProvider CPUExecutionProvider
Number of inputs = 1
Number of output = 2
input_dims: 1 3 224 224
output_dims: 1 1 224 224
output_dims: 1
2023-01-06 15:02:23.6623457 [E:onnxruntime:, sequential_executor.cc:369 onnxruntime::SequentialExecutor::Execute] Non-zero status code returned while running Pow node. Name:'Pow_74' Status Message: D:\a_work\1\s\onnxruntime\core\framework\bfc_arena.cc:342 onnxruntime::BFCArena::AllocateRawInternal Available memory of 0 is smaller than requested bytes of 1972518912

Non-zero status code returned while running Pow node. Name:'Pow_74' Status Message: D:\a_work\1\s\onnxruntime\core\framework\bfc_arena.cc:342 onnxruntime::BFCArena::AllocateRawInternal Available memory of 0 is smaller than requested bytes of 1972518912
这是cuda没调用起来么？用CPU可以测试，速度有点慢

[NagatoYuki0943]

Available memory of 0 is smaller than requested bytes of 1972518912 显存不够用，我复刻的anomalib中有python的onnxruntime推理 https://github.com/NagatoYuki0943/anomalib/blob/main/tools/read/onnxruntime_infer.py ，试试这个管不管用，如果报错相同就可能是模型的一些模型导出为onnx出问题了