Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build aws updates #2977

Draft
wants to merge 94 commits into
base: develop
Choose a base branch
from

Conversation

TerrenceMcGuinness-NOAA
Copy link
Collaborator

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA commented Oct 3, 2024

Description

A few version and patch updates to build and run global-workflow on Parallel Works AWS

Terry.McGuinness /build/global-workflow_forked/sorc (test_pw_ghrunner) $ ./build_all.sh -j 8
Building ufs, gfs_utils, ww3prepost, ufs_utils, upp
Starting build_ufs.sh
Starting build_gfs_utils.sh
Starting build_ww3prepost.sh
Starting build_ufs_utils.sh
Starting build_upp.sh
build_gfs_utils.sh completed successfully!
build_ww3prepost.sh completed successfully!
build_ufs_utils.sh completed successfully!
build_ufs.sh completed successfully!
build_upp.sh completed successfully!

 .... Build system finished ....

Built and ran on:

Terry.McGuinness ~ $ neo
                 ..                    Terry.McGuinness@mgmt-terrymcguinness-awsemctmcgc7i48xlargeciplatform-00004 
               .PLTJ.                  --------------------------------------------------------------------------- 
              <><><><>                 OS: CentOS Linux 7 (Core) x86_64 
     KKSSV' 4KKK LJ KKKL.'VSSKK        Host: c7i.2xlarge 
     KKV' 4KKKKK LJ KKKKAL 'VKK        Kernel: 3.10.0-1160.88.1.el7.x86_64 
     V' ' 'VKKKK LJ KKKKV' ' 'V        Uptime: 46 mins 
     .4MA.' 'VKK LJ KKV' '.4Mb.        Packages: 1933 (rpm) 
   . KKKKKA.' 'V LJ V' '.4KKKKK .      Shell: bash 4.2.46 
 .4D KKKKKKKA.'' LJ ''.4KKKKKKK FA.    Resolution: 5113x1387 
<QDD ++++++++++++  ++++++++++++ GFD>   WM: Metacity (Marco) 
 'VD KKKKKKKK'.. LJ ..'KKKKKKKK FV     Theme: Adwaita [GTK2/3] 
   ' VKKKKK'. .4 LJ K. .'KKKKKV '      Icons: Adwaita [GTK2/3] 
      'VK'. .4KK LJ KKA. .'KV'         Terminal: /dev/pts/3 
     A. . .4KKKK LJ KKKKA. . .4        CPU: Intel Xeon Platinum 8488C (4) @ 2.400GHz 
     KKA. 'KKKKK LJ KKKKK' .4KK        GPU: 00:03.0 Amazon.com, Inc. Device 1111 
     KKSSA. VKKK LJ KKKV .4SSKK        Memory: 763MiB / 15600MiB 
              <><><><>                 GPU Driver: i2c_piix4 
               'MKKM'                  CPU Usage: 0% 
                 ''                    Disk (/): 24G / 100G (24%)

->

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO (If YES, please add a link to any PRs that are pending.)
    • EMC verif-global
    • GDAS
    • GFS-utils
    • GSI
    • GSI-monitor
    • GSI-utils
    • UFS-utils
    • UFS-weather-model
    • wxflow

How has this been tested?

ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
ci/scripts/utils/provision_runner.sh Fixed Show fixed Hide fixed
TerrenceMcGuinness-NOAA added a commit that referenced this pull request Oct 16, 2024
# Description

This PR has the GitHub Pipeline script in the `github/workflows`
directory for running CI tests
to be preformed an AWS virtual cluster. It is setup to be launched from
the dispatch action from the Actions tab.

For now it will only run C48_ATM 

Resolves #3006 

Once the yaml pipeline is in `.github/workflows` directory of the
default branch we can test it against [PR
2977](#2977) which may
be needed to build on Parallel Works Centos AWS.

Code managers can check to see if the self-hosted runner
[globalworkflow_parallelworks](https://github.com/NOAA-EMC/global-workflow/settings/actions/runners/22)
is up and ready by checking the
[Running](https://github.com/NOAA-EMC/global-workflow/settings/actions/runners)
Settings.

In pending work we should also be able spin up the cluster on demand
from GitHub as well.

<!-- For more on writing good commit messages, see
https://cbea.ms/git-commit/ -->

# Type of change
- [ ] Bug fix (fixes something broken)
- [ ] New feature (adds functionality)
- [x] Maintenance (code refactor, clean-up, new CI test, etc.)

# Change characteristics
<!-- Choose YES or NO from each of the following and delete the other
-->
- Is this a breaking change (a change in existing functionality)? YES/NO
- Does this change require a documentation update? YES/NO
- Does this change require an update to any of the following submodules?
YES/NO (If YES, please add a link to any PRs that are pending.)
  - [ ] EMC verif-global <!-- NOAA-EMC/EMC_verif-global#1234 -->
  - [ ] GDAS <!-- NOAA-EMC/GDASApp#1234 -->
  - [ ] GFS-utils <!-- NOAA-EMC/gfs-utils#1234 -->
  - [ ] GSI <!-- NOAA-EMC/GSI#1234 -->
  - [ ] GSI-monitor <!-- NOAA-EMC/GSI-Monitor#1234 -->
  - [ ] GSI-utils <!-- NOAA-EMC/GSI-Utils#1234 -->
  - [ ] UFS-utils <!-- ufs-community/UFS_UTILS#1234 -->
  - [ ] UFS-weather-model <!-- ufs-community/ufs-weather-model#1234 -->
  - [ ] wxflow <!-- NOAA-EMC/wxflow#1234 -->

# How has this been tested?
<!-- Please list any test you conducted, including the machine.

CI Tests runs-end-to end on an AWS Centos based virtual cluster on
Parallel Works.

-->

# Checklist
- [ ] Any dependent changes have been merged and published
- [x] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have documented my code, including function, input, and output
descriptions
- [ ] My changes generate no new warnings
- [ ] New and existing tests pass with my changes
- [x] This change is covered by an existing CI test or a new one has
been added
- [ ] I have made corresponding changes to the system documentation if
necessary

---------

Co-authored-by: tmcguinness <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants