Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use two-phase deployment for prod.shared #6680

Open
achave11-ucsc opened this issue Nov 1, 2024 · 3 comments
Open

Use two-phase deployment for prod.shared #6680

achave11-ucsc opened this issue Nov 1, 2024 · 3 comments
Assignees
Labels
+ [priority] High doc [subject] Internal and external documentation enh [type] New feature or request infra [subject] Project infrastructure like CI/CD, build and deployment scripts orange [process] Done by the Azul team

Comments

@achave11-ucsc
Copy link
Member

achave11-ucsc commented Nov 1, 2024

@hannes-ucsc: "We were recently putting the finishing touches on a previous promotion (rerunning the deploy and deploy_browser jobs) while already preparing the next one (deploying prod.shared from the PR branch). On prod, the shared deployment is done in one step, which means unused Docker images are removed from ECR right after their replacements have been copied. This could prevent us from rerunning the build_image and test job of the most recent pipeline since both jobs depend on images from ECR, but only if the images were also removed from the local image store in the DinD container."

@achave11-ucsc achave11-ucsc added the orange [process] Done by the Azul team label Nov 1, 2024
@achave11-ucsc achave11-ucsc changed the title Use two phase deployment for prod.shared Use two phase deployment for prod.shared Nov 1, 2024
@hannes-ucsc hannes-ucsc changed the title Use two phase deployment for prod.shared Use two-phase deployment for prod.shared Nov 2, 2024
@hannes-ucsc
Copy link
Member

Spike to reproduce. On tempdev, delete the base image of the Azul image (python), the BQ emulator image and the ES image from ECR and then rerun the jobs in the most recent pipeline.

@achave11-ucsc
Copy link
Member Author

@hannes-ucsc: "It may take more time to reproduce in tempdev as instructed above then it would take to just modify the PR template check list. I'd like to think about this some more."

@hannes-ucsc
Copy link
Member

We'll just implement the CL changes without trying to reproduce the suspected negative impact.

@hannes-ucsc hannes-ucsc added enh [type] New feature or request doc [subject] Internal and external documentation infra [subject] Project infrastructure like CI/CD, build and deployment scripts - [priority] Medium + [priority] High and removed - [priority] Medium labels Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
+ [priority] High doc [subject] Internal and external documentation enh [type] New feature or request infra [subject] Project infrastructure like CI/CD, build and deployment scripts orange [process] Done by the Azul team
Projects
None yet
Development

No branches or pull requests

2 participants