At line, I am wondering why the singularity check is made with torch.linalg.matrix_rank instead of torch.linalg.cond?
According to the screenshot, the matrix is extremely singular but still have a rank of 3, so I guess it will be better to check singularity with torch.linalg.cond?