BLOM iHAMOCC regression testing with NorESM

Regression testing for BLOM/iHAMOCC development can be done with the buildt-in CIME Case Control System (CCS) that is provided with the NorESM source code. Basic funtionality is included in the NorESM documentation section on system testing with NorESM.

Regression test system

The regression test system is located under cime/scripts, and called by running

./create_test TESTNAME

which will execute case.setup, case.build and case.submit.

Available regression tests for BLOM

$ ./query_testlists --xml-category aux_blom_noresm
aux_blom_noresm: SMS_D_Ld1.T62_tn14.NOINYOC.betzy_intel
aux_blom_noresm: ERS_Ld5.T62_tn14.NOINYOC.betzy_intel
aux_blom_noresm: ERS_Ld5.T62_tn14.NOINY.betzy_intel
aux_blom_noresm: ERS_Ld5.T62_tn14_wtn14nw.NOINY_WW3.betzy_intel
aux_blom_noresm: ERS_Ld5.T62_tn14_wtn14nw.NOINY_WW3.betzy_intel.blom-wavice

Run a single test on betzy

./create_test 
    SMS_D_Ld1.T62_tn14.NOINYOC.betzy_intel
    --xml-machine betzy
    --xml-compiler intel 
    --project <your_project>

Run a pre-defined test suite on betzy

./create_test 
    --xml-category aux_blom_noresm
    --xml-machine betzy
    --xml-compiler intel 
    --project <your_project>

Generate new baselines

./create_test 
    --xml-category aux_blom_noresm
    --xml-machine betzy
    --xml-compiler intel 
    --generate <your_baseline_directory_name>
    --baseline-root /cluster/shared/noresm/noresm_baselines 
    --project <your_project>

Comparing regression test with existing baseline

./create_test 
    --xml-category aux_blom_noresm
    --xml-machine betzy
    --xml-compiler intel 
    --compare <your_baseline_directory_name>
    --baseline-root /cluster/shared/noresm/noresm_baselines 
    --project <your_project>