Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Minimal Nvidia GPU image #5

Draft
wants to merge 16 commits into
base: main
Choose a base branch
from
Draft

Minimal Nvidia GPU image #5

wants to merge 16 commits into from

Commits on Aug 9, 2024

  1. Change default AMI_REGIONS to eu-west-2

    @ruffsl
    ruffsl committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    5d88034 View commit details
    Browse the repository at this point in the history

  2. Change source AMI for gpu image 

    to use NVIDIA GPU-Optimized AMI
- https://aws.amazon.com/marketplace/pp/prodview-7ikjtg3um26wq
    @ruffsl
    ruffsl committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    063820a View commit details
    Browse the repository at this point in the history

  3. Set instance_type to g4dn.xlarge for amazon-ebs 

    given that the Nvidia source image requires a GPU
>   2024-08-09T03:45:28Z: ==> amazon-ebs.build_ebs: Error waiting for fleet request (fleet-d6b5ce15-8087-660d-0e92-0982be357801) to become ready:The instance configuration for this AWS Marketplace product is not supported. Please see the AWS Marketplace site for more information about supported instance types, regions, and operating systems.
    @ruffsl
    ruffsl committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    f06df40 View commit details
    Browse the repository at this point in the history

  4. Set VOLUME_SIZE to 128 

    given that 80 is too small for Nvidia source image
> 2024-08-09T03:11:58Z: ==> amazon-ebs.build_ebs: Error waiting for fleet request (fleet-5415661f-0887-e407-0630-81802dcb1f95) to become ready:Your requested instance type (c7a.xlarge) is not supported in your requested Availability Zone (eu-west-2c).Your requested instance type (m7a.xlarge) is not supported in your requested Availability Zone (eu-west-2c).Volume of size 80GB is smaller than snapshot 'snap-00c0e57c77605a262', expect size>= 128GB
    @ruffsl
    ruffsl committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    d8b2045 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Comment out install-aws-tools.sh from patch 

    as it conflicts with Nvidia source image
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    5317463 View commit details
    Browse the repository at this point in the history

  2. Comment out unnecessary installs

    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    e076c2c View commit details
    Browse the repository at this point in the history

  3. Apply patch to ubuntu 22.04 template 

    `./bin/patch/ubuntu22-x64 releases/ubuntu22/x64`
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    004a3f9 View commit details
    Browse the repository at this point in the history

  4. Run configure-apt-mock.sh prior to pre.sh 

    given that nvidia source image apt installs drivers at startup
so we need to wait for dpkg locks to release
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    e024b29 View commit details
    Browse the repository at this point in the history

  5. Apply patch to ubuntu 22.04 template 

    `./bin/patch/ubuntu22-x64 releases/ubuntu22/x64`
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    aef421b View commit details
    Browse the repository at this point in the history

  6. Comment out install-docker.sh from patch 

    as it conflicts with Nvidia source image
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    eb12b41 View commit details
    Browse the repository at this point in the history

  7. Apply patch to ubuntu 22.04 template 

    `./bin/patch/ubuntu22-x64 releases/ubuntu22/x64`
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7436a49 View commit details
    Browse the repository at this point in the history

  8. Backport instance_type GPU change into patch

    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    82464d9 View commit details
    Browse the repository at this point in the history

  9. Do not make AMIs publicly accessible 

    ```
2024/08/14 19:31:55 ui error: 2024-08-14T19:31:55Z: ==> amazon-ebs.build_ebs: Error modify AMI attributes: AuthFailure: AMIs with product codes can't be made public
```
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    7b898ca View commit details
    Browse the repository at this point in the history

  10. Apply patch to ubuntu 22.04 template 

    `./bin/patch/ubuntu22-x64 releases/ubuntu22/x64`
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f29f1d0 View commit details
    Browse the repository at this point in the history

  11. Comment out install-rust.sh from patch 

    because it takes so much time to build
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    cc7bb4a View commit details
    Browse the repository at this point in the history

  12. Apply patch to ubuntu 22.04 template 

    `./bin/patch/ubuntu22-x64 releases/ubuntu22/x64`
    @ruffsl
    ruffsl committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    a7b1d66 View commit details
    Browse the repository at this point in the history