Re: building petsc on a POWER5+ machine

["Thomas Geenen" <geenen@xxxxxxxxx>]

oke maybe i did not explain it clear enough.
i already build petsc with support for hypre and mumps the more or
less default way. yes you will have to do a lot of tweaking but that
went oke.
The problem was that in this version Mumps would hang in the
factorisation phase.
the next thing i did was building mumps standalone linking it to essl
and pessl this gave a working standalone version of mumps.
So the next thing i tried was building petsc with mumps supprt without
blacs or scalapack but with essl and pessl to get a working version of
mumps accesible through petsc.

this however seems tricky since scalapack does not build with essl
and/or pessl and mumps only builds if you build scalapack as well.

a worksround would be to link my working version of mumps directly to
petsc and maybe rebuilding some part of mumps that deals with the
interface?

i also tried

./config/configure.py --with-memcmp-ok --with-endian=big
--sizeof_char=1 --sizeof_void_p=8 --sizeof_short=2 --sizeof_int=4
--sizeof_long=8 --sizeof_long_long=8 --sizeof_float=4
--sizeof_double=8 --bits_per_byte=8 --sizeof_MPI_Comm=4
--sizeof_MPI_Fint=4 --with-batch --with-shared=0
--with-mpirun=mpirun.lsf --with-mpi-dir=/usr/lpp/ppe.poe/
--with-mpi-shared=yes --with-fc=mpxlf_r --with-cc=mpcc_r
--with-hypre=yes --with-mumps=yes
--with-hypre-dir=/blhome/geenen/source/petsc-2.3.2-p8/externalpackages/hypre-1.11.1b/src/hypre/
--with-mumps-dir=/blhome/geenen/source/petsc-2.3.2-p8/externalpackages/MUMPS_4.6.3/
--with-scalapack-lib=/usr/lib/libpessl.a
--with-blacs-lib=/usr/lib/libessl.a
--with-scalapack-include=/usr/include/
with-blacs-include=/usr/include/
=================================================================================
            Configuring PETSc to compile on your system
=================================================================================
TESTING: check from
config.libraries(/ptmp/huangwei/petsc-2.3.2-p8/python/BuildSystem/config/libraries.py:108)
*********************************************************************************
        UNABLE to CONFIGURE with GIVEN OPTIONS    (see configure.log
for details):
---------------------------------------------------------------------------------------
--with-blacs-lib=['/usr/lib/libessl.a'] and
--with-blacs-include=/usr/include/ did not work
*********************************************************************************
so without the --with-blacs and --with-scalapack but the build system
tries to execute this
int main() {
blacs_pinfo()
;
 return 0;
}

and that results of course in

error message = {ld: 0711-317 ERROR: Undefined symbol: .blacs_pinfo

thomas

On 3/16/07, Satish Balay <balay@xxxxxxxxxxx> wrote:
> A couple of issues here..
>
>  - xlf doesn't compile [mumps] f90 code correctly - You'll need the
>    additional compiler option "-qnosave". This can be specified as:
>    --with-fc='mpxlf_r -qnosave'
>
>  - Alternative would be to use 'mpxlf90' but either blacs or scalapack
>    sources can't be compiled with it due to fixed/free from issue. I
>    guess one could use: --with-fc='mpxlf90 -qnosave'
>
> >  --with-scalapack-lib=/usr/lib/libpessl.a  --with-blacs-lib=/usr/lib/libessl.a
>
> I don't think essl has either scalapack or blacs functionality. You should
> just use: --download-blacs=1 --download-scalapack=1
>
> Satish
>
> On Fri, 16 Mar 2007, Thomas Geenen wrote:
>
> > dear petsc users,
> >
> > I build petsc on a POWER5+ machine.
> > now i would like to add mumps.
> > if i do that the way it should de done i end up with a version in
> > which mumps hangs during the factorization phase.
> > If i build mumps standalone linking to essl and pessl i get a working
> > version of mumps.
> >
> > I tried telling the petsc configuration to use essl and pessl instead
> > of scalapack and blacs like this
> > --with-scalapack=yes --with-scalapack-lib=/usr/lib/libpessl.a
> > --with-blacs=yes --with-blacs-lib=/usr/lib/libessl.a
> > --with-scalapack-include=/usr/include/
> > with-blacs-include=/usr/include/
> >
> > resulting in
> > =================================================================================
> > TESTING: check from
> > config.libraries(/ptmp/huangwei/petsc-2.3.2-p8/python/BuildSystem/config/libraries.py:108)
> > *********************************************************************************
> >         UNABLE to CONFIGURE with GIVEN OPTIONS    (see configure.log
> > for details):
> > ---------------------------------------------------------------------------------------
> > --with-blacs-lib=['/usr/lib/libessl.a'] and
> > --with-blacs-include=/usr/include/ did not work
> > *********************************************************************************
> >
> > so how can i either link my working version of mumps to petsc without
> > having a scalapack or blacs lib or include,
> > or use essl and pessl as substitute for scalapack and blacs and rebuild petsc
> >
> > cheers
> > Thomas
> >
> > complete config option list
> > ./config/configure.py --with-memcmp-ok --with-endian=big
> > --sizeof_char=1 --sizeof_void_p=8 --sizeof_short=2 --sizeof_int=4
> > --sizeof_long=8 --sizeof_long_long=8 --sizeof_float=4
> > --sizeof_double=8 --bits_per_byte=8 --sizeof_MPI_Comm=4
> > --sizeof_MPI_Fint=4 --with-batch --with-shared=0
> > --with-mpirun=mpirun.lsf --with-mpi-dir=/usr/lpp/ppe.poe/
> > --with-mpi-shared=yes --with-fc=mpxlf_r --with-cc=mpcc_r
> > --with-hypre=yes --with-mumps=yes
> > --with-hypre-dir=/blhome/geenen/source/petsc-2.3.2-p8/externalpackages/hypre-1.11.1b/src/hypre/
> > --with-mumps-dir=/blhome/geenen/source/petsc-2.3.2-p8/externalpackages/MUMPS_4.6.3/
> > --with-scalapack=yes --with-scalapack-lib=/usr/lib/libpessl.a
> > --with-blacs=yes --with-blacs-lib=/usr/lib/libessl.a
> > --with-scalapack-include=/usr/include/
> > with-blacs-include=/usr/include/
> >
> >