Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor artifact cleanup #484

Merged
merged 6 commits into from
Aug 1, 2023
Merged

Conversation

guineveresaenger
Copy link
Contributor

This pull request removes the artifact-cleanup.yml Workflow from all managed providers.
Instead, we will use the retention-days feature of the upload-artifact Action to have artifacts expire after 30 days.
Previously, we ran the artifact cleanup Workflow on a cron that would remove all artifacts older than 30 days.
With this change, we are setting artifacts to expire after 30 days instead of the default 90 days that upload-artifact provides.
This is a very likely fix for pulumi/pulumi-azure-native#2558 and pulumi/pulumi-kubernetes#2499, et al, since the Action we used in artifact-cleanup.yml caused a secondary rate limit error.
Related: pulumi/pulumi-aws#2649.
h/t to @aq17 for finding this neat feature of upload-artifact ❤️

  • Remove artifact cleanup cron and set retention-days to 30 on Upload Artifact job itself
  • Regenerate tf providers
  • Native providers: Remove artifact cleanup workflow and add retention-days to upload-artifacts job
  • Generate native provider CI

@guineveresaenger
Copy link
Contributor Author

guineveresaenger commented Jul 27, 2023

EDIT:

I learned that native providers are no longer managed via this repository. This will not fix any native provider CI.
I will file separate PRs.
Fixes pulumi/pulumi-azure-native#2558
Fixes pulumi/pulumi-kubernetes#2499

@guineveresaenger
Copy link
Contributor Author

guineveresaenger commented Jul 28, 2023

@iwahbe based on feedback from @thomas11 I removed the retention days from any workflows triggered by tags. We will keep release and prerelease artifacts for the default 90 days.

@guineveresaenger guineveresaenger requested a review from iwahbe July 28, 2023 17:28
Copy link
Member

@iwahbe iwahbe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@iwahbe based on feedback from @thomas11 I removed the retention days from any workflows triggered by tags. We will keep release and prerelease artifacts for the default 90 days.

That doesn't sound right to me. We are able to access release artifacts that are older than 90 days. This is the pulumi-aws v5.18.0, released mid-october of 2022. All the released artifacts are accessible.

The artifacts as stored as part of the release action are inaccessible, but that doesn't matter. We don't expect users to consume artifacts from of the release action, just the actual release.

I think a 30 day retention period is fine. There isn't a clear reason to special case these workflow artifacts compared to other workflow artifacts.

CC @thomas11 @mikhailshilkov

@guineveresaenger guineveresaenger merged commit c8f8344 into master Aug 1, 2023
@guineveresaenger guineveresaenger deleted the guin/artifact-cleanup-fix branch August 1, 2023 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants