Calculate the determinant of two 3x3 matrixes