/mpas-bundle

CMake build configuration for JEDI-MPAS application

Primary LanguageShellApache License 2.0Apache-2.0

(C) Copyright 2017-2021 UCAR

This software is licensed under the terms of the Apache Licence Version 2.0 which can be obtained at http://www.apache.org/licenses/LICENSE-2.0.

Table of Contents

Installation

Git Configuration

  • It's recommended to configure Git using command line to simplify repository access. You can set your name and email, which helps avoid repeatedly entering your credentials. Run the following commands in your terminal:

    # Set your name
    git config --global user.name "Your Name"
    
    # Set your email
    git config --global user.email "yourname@somewhere.something"
    
    # Set credential helper with timeout
    git config --global credential.helper 'cache --timeout=3600'
  • Ensure Git LFS is installed and configured prior to building mpas-bundle.

    git lfs install

Installation Steps

For performance and memory reasons, it is recommended to compile mpas-bundle using the gnu platform.

  • Clone the Repository: Clone the mpas-bundle repository and navigate into the repository's root directory.

    git clone https://github.com/JCSDA/mpas-bundle.git
    cd mpas-bundle

  • To set up your environment for building mpas-bundle, run the appropriate environment setup script for your computing and compiler platform. The compiler/shell specific environment configuration commands are listed in the below table.

    GNU Intel
    zsh/bash source env-setup/gnu-derecho.sh source env-setup/intel-derecho.sh
    csh/tcsh source env-setup/gnu-derecho.csh source env-setup/intel-derecho.csh
  • Create and navigate into the build directory.

      mkdir <mpas-bundle_build_dir> 
      cd <mpas-bundle_build_dir> 
  • Run CMake to configure the build. Though not required, you can pass flags to cmake that define the build type, makefile verbosity, build engine, and compiler flags. A table of useful CMake flags can be found here.

    cmake <mpas-bundle_dir> <cmake_flags> 

Building on a Compute Node

Due to resource limitations, it's recommended to build and run tests on a compute node.

  • Use the run_make.bundle.sh script to generate a batch job for building.

    bash <mpas_bundle_dir>/env-setup/run_make.bundle.sh -A <derecho_account> -e <mpas-bundle_dir>/env-setup -c <compiler> -n
  • Submit the job with qsub.

    qsub make.pbs.sh 
  • When the above job finishes, generate a batch job for running mpas-jedi's test suite and submit it using qsub

    bash <mpas_bundle_dir>/env-setup/run_make.bundle.sh -A <derecho_account> -e <mpas-bundle_dir>/env-setup -c <compiler> -x ctest -n
    qsub ctest.pbs.sh

Building in an Interactive Session

  • Start an interactive session.
    qsub -A <derecho_account> -N cc-mpas-bundle -q main -l walltime=03:00:00 -l select=1:ncpus=8 -I
  • Once the session starts, source the environment configuration script as you did in this step.
  • Enter the mpas-bundle build directory
    cd <mpas_bundle_build_dir>
    and start the build. Make sure to specify the number of cores GNU Make should use with the -j flag. In the below command, mpas-bundle is compiled using 8 cores.
    make -j8
    and run ctest. You can execute ctest without any flags to run all available tests with default settings. However, ctest supports numerous flags that allow you to customize the test execution. For a table of useful ctest flags, click here.
    ctest <ctest_flags>

Useful CMake Flags

Flag Description Acceptable Values
-G Specifies the generator to use for the build system. Unix Makefiles, Ninja, etc.
-DCMAKE_BUILD_TYPE Defines the type of build. Debug, Release, RelWithDebInfo, MinSizeRel
-DCMAKE_VERBOSE_MAKEFILE Enables verbose output from the makefile, useful for debugging. ON, OFF
-DCMAKE_C_FLAGS Allows specification of additional flags for the C compiler. Compiler flags (e.g., -O3, -Wall, etc.)
-DCMAKE_CXX_FLAGS Allows specification of additional flags for the C++ compiler. Compiler flags (e.g., -O3, -Wall, etc.)
-DCMAKE_Fortran_FLAGS Allows specification of additional flags for the Fortran compiler. Compiler flags (e.g., -O3, -Wall, etc.)
-D Passes any variable definition to CMake, used for custom options in CMakeLists.txt. Variable=Value (e.g., MY_CUSTOM_OPTION=ON, etc.)
--build Builds a CMake-generated project binary tree. Build directory path

Useful CTest Flags

Flag Description Acceptable Values
--build-and-test Build and test a project. Path to project and build tree, additional arguments
--test-action Specifies the action to perform (e.g., test, start, update, configure, build). test, start, update, configure, build
--output-on-failure Output anything from the test program if it fails. N/A
--parallel Run the tests in parallel using the given number of jobs. Number of jobs (e.g., 4)
--schedule-random Schedule tests in random order. N/A
--stop-on-failure Stop running tests after the first test fails. N/A
--timeout Set a global timeout for all tests, after which CTest will kill the test. Timeout in seconds (e.g., 120)
--verbose Enable verbose output from tests. N/A
--repeat Repeat the tests according to a specified mode (e.g., until fail, until pass, after timeout). until-fail, until-pass, after-timeout
--extra-submit Specify files to submit to a dashboard. Files are submitted to the first dashboard mentioned in CTestConfig.cmake. File paths
--label-summary Print a summary of test results grouped by label. N/A
--subproject-summary Print a summary of test results grouped by subproject. N/A
-C or --build-config Specify the configuration type to build/test when using a multi-configuration generator (e.g., Visual Studio). Debug, Release, MinSizeRel, RelWithDebInfo
-R or --tests-regex Run only the tests whose names match the given regular expression. Regular expression (e.g., MyTest*)
-E or --exclude-regex Exclude tests whose names match the given regular expression. Regular expression (e.g., LongRunningTest*)
-L or --label-regex Run only the tests with labels matching the given regular expression. Regular expression (e.g., Nightly*)
-j or --parallel Run the tests in parallel using the given number of jobs. Number of jobs (same as --parallel)