scivision/mumps

64-bit integer use of MUMPS always meet INFO(1)=-3

GuoqiMa opened this issue · 1 comments

Hi, I am trying to using 64 bit integer of MUMPS. I add -i8 to the compiler as below,

_mpiifort -O2 -xHost -nofor-main -DBLR_MT -qopenmp -c -i8 $filename.f90 -o $filename.o

mpiifort -o $filename -O2 -xHost -nofor-main -qopenmp $filename.o -lzmumps -lmumps_common -lmpi -lpord -lmkl_scalapack_lp64 -lmkl_blacs_intelmpi_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -lpthread -lparmetis -lmetis -lptesmumps -lptscotch -lptscotcherr -lscotch_

But it doesn't help. always meet errors like this, I really need your help. Do the others like Metis, SCOTCH shoule be installed with 64-bit integer? Could you give some details? thanks very much.

** ERROR RETURN ** FROM ZMUMPS INFO(1)= -3
** INFO(2)= 0
** ERROR RETURN ** FROM ZMUMPS INFO(1)= -3
** INFO(2)= 0
** ERROR RETURN ** FROM ZMUMPS INFO(1)= -3
** INFO(2)= 0
** ERROR RETURN ** FROM ZMUMPS INFO(1)= -3
** INFO(2)= 0
** ERROR RETURN ** FROM ZMUMPS INFO(1)= -3
** INFO(2)= 0
Abort(67706631) on node 2 (rank 2 in comm 0): Fatal error in PMPI_Bcast: Invalid root, error stack:
PMPI_Bcast(451): MPI_Bcast(buf=0x7fffdd81fd88, count=1, MPI_INTEGER, root=-1073741822, comm=comm=0x84000002) failed
PMPI_Bcast(412): Invalid root (value given was -1073741822)
Abort(134815495) on node 3 (rank 3 in comm 0): Fatal error in PMPI_Bcast: Invalid root, error stack:
PMPI_Bcast(451): MPI_Bcast(buf=0x7ffc093ad608, count=1, MPI_INTEGER, root=-1073741822, comm=comm=0x84000002) failed
PMPI_Bcast(412): Invalid root (value given was -1073741822)
Abort(671686407) on node 4 (rank 4 in comm 0): Fatal error in PMPI_Bcast: Invalid root, error stack:
PMPI_Bcast(451): MPI_Bcast(buf=0x7ffcf61d6808, count=1, MPI_INTEGER, root=-1073741822, comm=comm=0x84000002) failed
PMPI_Bcast(412): Invalid root (value given was -1073741822)
Abort(1007230727) on node 0 (rank 0 in comm 0): Fatal error in PMPI_Bcast: Invalid root, error stack:
PMPI_Bcast(451): MPI_Bcast(buf=0x7ffe446fe808, count=1, MPI_INTEGER, root=-1073741822, comm=comm=0x84000003) failed
PMPI_Bcast(412): Invalid root (value given was -1073741822)
Abort(738795271) on node 1 (rank 1 in comm 0): Fatal error in PMPI_Bcast: Invalid root, error stack:
PMPI_Bcast(451): MPI_Bcast(buf=0x7ffe6bbeb588, count=1, MPI_INTEGER, root=-1073741822, comm=comm=0x84000002) failed
PMPI_Bcast(412): Invalid root (value given was -1073741822)

I think Scotch and MUMPS have to both be built with 64-bit or 32-bit. I updated the build script for Scotch to have this option.

So pick a new install test directory, say ~/mumps64 and do like the following from the mumps/ Git source directory:

cmake -Dintsize64=on -Dprefix=~/mumps64 -P scripts/build_scotch.cmake

cmake -Bbuild -DCMAKE_PREFIX_PATH=~/mumps64 -Dintsize64=on -Dscotch=on 
cmake --build build

Then link your project as you did above.