torch.svd error
Opened this issue · 0 comments
When I run the inferences,the program failed:
True
True
0
True
Forward timestep: [0, 39, 78, 118, 157, 196, 235, 274, 314, 353, 392, 431, 471, 510, 549]
Backward timestep: [0, 7, 13, 20, 26, 33, 39, 46, 52, 59, 65, 72, 78, 85, 92, 98, 105, 111, 118, 124, 131, 137, 144, 150, 157, 163, 170, 176, 183, 190, 196, 203, 209, 216, 222, 229, 235, 242, 248, 255, 261, 268, 274, 281, 288, 294, 301, 307, 314, 320, 327, 333, 340, 346, 353, 359, 366, 373, 379, 386, 392, 399, 405, 412, 418, 425, 431, 438, 444, 451, 457, 464, 471, 477, 484, 490, 497, 503, 510, 516, 523, 529, 536, 542, 549]
Aligned timestep: []
begin
8
Traceback (most recent call last):
File "/data/workspace/jaccob/SSD/inference_ir.py", line 47, in
inferencer.eval()
File "/data/workspace/jaccob/SSD/trainer/trainer.py", line 581, in eval
self.deg_operator = DeblurGaussOperator()
File "/data/workspace/jaccob/SSD/measure/measurement.py", line 135, in init
A_funcs = Deblurring(kernel / kernel.sum(), channels, img_size)
File "/data/workspace/jaccob/SSD/functions/svd_operators.py", line 953, in init
self.U_small, self.singulars_small, self.V_small = torch.svd(A_small, some=False)
RuntimeError: cusolver error: CUSOLVER_STATUS_INTERNAL_ERROR, when calling cusolverDnCreate(handle)