Information/Instructions/Configure
From C-SAFE Wiki
Contents |
General Information
For information on how to 'configure' the Uintah software, please see the installation guide located at http://www.uintah.utah.edu/wiki/Documentation. Configure lines for specific machines are listed below.
WARNING, it is possible that some of these configure lines are out of date! Also, in case you need them, a large number of configure lines are in the wiki history for machines that have been deprecated.
Arches (CHPC Cluster)
Sanddune Arch
Create a directory for the build:
cd SCIRun mkdir sda_linux_opt cd sda_linux_opt
- Optimized configure line for MPI2:
../src/configure \ --with-petsc=/uufs/arches/sys/pkg/petsc/2.2.1_atl_mpich2 \ --with-mpi=/uufs/arches/sys/pkg/mpich2/std \ --with-hypre=/uufs/chpc.utah.edu/common/home/u0554432/pkg/hypre_install \ --enable-64bit \ PETSC_ARCH=linux-gnu \ LDFLAGS="-lpthread -lrt"
Now run the make command:
make sus
Delicate Arch
- Optimized configure line:
../src/configure \ --enable-64bit \ --with-acml=/uufs/arches/sys/pkg/acml/3.5.0/gnu64 \ --with-mpi=/uufs/delicatearch.arches/sys/pkg/mpich-mx/1.2.7..3 \ --with-mx=/uufs/delicatearch.arches/sys/pkg/mx-2g/std \ --with-petsc=/uufs/delicatearch.arches/sys/pkg/petsc/2.3.3-p3_acml_mx \ --with-hypre=/uufs/delicatearch.arches/sys/pkg/hypre/2.0.0 \ PETSC_ARCH=linux-gnu \ CC=gcc \ CXX=g++ \ F77=g77
- Debug configure line:
../src/configure \ --enable-package=Uintah \ --enable-debug \ --enable-64bit \ --with-thirdparty=/uufs/chpc.utah.edu/common/home/u0554432/SCIRunNew/Thirdparty.install/1.25.4/Linux/gcc-3.4.6-64bit \ --with-acml=/uufs/arches/sys/pkg/acml/3.5.0/gnu64 \ --with-mpi=/uufs/delicatearch.arches/sys/pkg/mpich-mx/1.2.7..3 \ --with-mx=/uufs/delicatearch.arches/sys/pkg/mx-2g/std \ --with-petsc=/uufs/delicatearch.arches/sys/pkg/petsc/2.3.3-p3_acml_mx \ --with-hypre=/uufs/delicatearch.arches/sys/pkg/hypre/2.0.0 \ PETSC_ARCH=linux-gnu \ CC=gcc \ CXX=g++ \ F77=g77
LLNL
General notes at LLNL:
- Before you configure, make sure you are in the unix group "uintah". (Type 'groups' at the command prompt.) If you are not, ask Dav to request that you be added.
Hera
cd SCIRun mkdir hera64opt cd hera64opt
Optimized:
../src/configure \
--enable-64bit \
--enable-optimize="-O2 -fPIC" \
\
--with-mpi=/usr/gapps/uintah/Thirdparty-install/hera/MPI_Link \
--with-petsc=/usr/gapps/uintah/Thirdparty-install/hera/Uintah3P/gcc-4.1.2-64bit/petsc-2.3.3-p1-install \
--with-hypre=/usr/gapps/uintah/Thirdparty-install/hera/Uintah3P/gcc-4.1.2-64bit/hypre-2.0.0-install \
\
F77=gfortran \
PETSC_ARCH=linux-gnu-c-opt
Ranger
Intel Compiler
Please make sure you have intel/10.1 and mvapich-devel/1.0 modules loaded. You most likely want to add the following to your .login_user file as these modules will need to be loaded/unloaded at run-time as well:
# Unload some default modules: module unload pgi/7.1 module unload mvapich2 module load intel/10.1 module load mvapich-devel/1.0 module load beta # Have to load 'beta' before petsc to get the correct petsc module load petsc/2.3.3-dynamic # Probably don't use this: module load gotoblas
Optimized build configure line:
../src/configure \
--enable-64bit \
--enable-optimize="-O2 -fp-model precise -xW" \
--with-fortran=/opt/apps/intel/10.1/fc \
--with-mpi=/scratch/projects/tg/uintah/MPIs/mpi_icc_devel_1.0_link \
\
--with-mkl=/scratch/projects/tg/uintah/SystemLibLinks/mkl \
\
--with-hypre=/scratch/projects/tg/uintah/Uintah-Thirdparty-install/icc-10.1-64bit/using_MPI_1.0\
--with-petsc=/opt/apps/beta/petsc/petsc-2.3.3 \
\
--disable-sci-malloc \
--enable-assertion-level=0 \
\
CC=icc \
CXX=icpc \
F77=ifort \
\
PETSC_ARCH=barcelona-dynamic
For LARGE Runs (THIS MAY NOT HELP... Talk to Todd), using > 1000 processors, you may want to link vs this version of HYPRE:
--with-hypre=/scratch/projects/tg/uintah/Uintah-Thirdparty-install/icc-10.1-64bit/using_MPI_1.0-large-runs \
PGI Compiler
If you added the default 'module' commands for the Intel compiler to your login file (see above), you will need to do the following to set up for using the PGI compiler:
# module load beta # module load petsc/2.3.3-dynamic # Have to load 'beta' before petsc to get the correct petsc module unload mvapich2 module unload intel module load pgi module load mvapich2
Optimized build configure line:
../src/configure \
--enable-64bit \
--with-mpi=/scratch/projects/tg/uintah/MPIs/mpi_icc_devel_1.0_link \
\
--with-thirdparty=/scratch/projects/tg/uintah/SCIRun-Thirdparty-Install/1.25.4/Linux/pgcc-7.1-2-64bit \
\
--with-mkl=/scratch/projects/tg/uintah/SystemLibLinks/mkl \
\
'--enable-optimize=-O2' \
--disable-sci-malloc \
--enable-assertion-level=0 \
\
--with-hypre=/scratch/projects/tg/uintah/Uintah-Thirdparty-install/pgcc-7.1-2-64bit/hypre-2.0.0/using_MPI_1.0 \
--with-petsc=/opt/apps/beta/petsc/petsc-2.3.3 \
\
CC=pgcc \
CXX=pgCC \
F77=pgf77 \
\
PETSC_ARCH=barcelona-dynamic
Kraken
Add the following to your .login and .rc files
module load subversion module unload PrgEnv-pgi module load PrgEnv-gnu
Optimized configure line:
../src/configure --enable-opt=-O3 \ --with-mpi=/opt/mpt/3.5.0/xt/mpich2-gnu/ \ --enable-64bit --enable-package=Uintah \ F77=ftn --enable-static --enable-assertion-level=0
To run you must copy the sus executable from your home directory to the luster scratch directory located at /lustre/scratch/<username>/ and run it with '-do_not_validate' flag. Or you can check out the whole source tree and build in scratch directory, then run sus as usual without adding the flag.
Back to: Main:Information
