✨ Enable MWAA to read ECR in data-engineering-prod

[moj-supratikc]

Describe the feature request.

See Slack thread here for details: https://mojdt.slack.com/archives/C06TFT94JTC/p1728513340561769

Describe the context.

Have added functionality to airflow to automatically keep images updated on pipelines without manual intervention, but airflow needs permission to read ECR from a different AWS account.

Value / Purpose

This will allow pipelines to keep image versions updated automatically without the need to manually change them.

This will be particularly useful in dev pipelines built from shared generic repos (e.g. airflow-create-a-pipeline) as our dev pipelines will always run on the latest image and flag any errors to be fixed before updating images in prod.

User Types

Data Engineers

[simon-pope]

To be presented at Request forum 14th October