fix: check isScalingEvent only on stable and newRS #5173
2 fail, 7 skipped, 104 pass in 3h 17m 10s
4 files 4 suites 3h 17m 10s ⏱️
113 tests 104 ✅ 7 💤 2 ❌
454 runs 424 ✅ 28 💤 2 ❌
Results for commit 5413807.
Annotations
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / Published E2E Test Results
1 out of 5 runs failed: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.29)/junit-e2e-test.xml [took 1m 32s]
Raw output
Failed
=== RUN TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
time="2024-10-09T18:26:01Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2024-10-09T18:26:01Z" level=info msg="rollout.argoproj.io/updatescaling created\n" rollout=updatescaling
time="2024-10-09T18:26:01Z" level=info msg="Waiting for condition: status=Healthy" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=updatescaling
W1009 18:26:02.668882 27339 warnings.go:70] unknown field "spec.template.metadata.creationTimestamp"
time="2024-10-09T18:26:02Z" level=info msg="Patched rollout: {\"spec\":{\"template\":{\"spec\":{\"containers\":[{\"name\":\"updatescaling\",\"resources\":{\"requests\":{\"cpu\":\"2m\",\"memory\":\"16Mi\"}}}]}}}}" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Condition 'status.replicas=7' met after 0s" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Pod expectation 'canary pod count == 4' met" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Scaled rollout to 8" rollout=updatescaling
time="2024-10-09T18:26:02Z" level=info msg="Waiting for condition: status.replicas=11" rollout=updatescaling
time="2024-10-09T18:26:03Z" level=info msg="Condition 'status.replicas=11' met after 0s" rollout=updatescaling
time="2024-10-09T18:26:03Z" level=info msg="Pod expectation 'canary pod count == 8' met" rollout=updatescaling
time="2024-10-09T18:26:03Z" level=info msg="Pod expectation 'stable pod count == 3' met" rollout=updatescaling
time="2024-10-09T18:26:03Z" level=info msg="Scaled rollout to 4" rollout=updatescaling
time="2024-10-09T18:26:03Z" level=info msg="Waiting for condition: status.replicas=7" rollout=updatescaling
when.go:467: timeout after 1m30s waiting for condition status.replicas=7
Name: updatescaling
Namespace: default
Status: �[32m✔�[0m Healthy
Strategy: Canary
Step:
SetWeight: 100
ActualWeight: 100
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 4
Current: 4
Updated: 4
Ready: 4
Available: 4
NAME KIND STATUS AGE INFO
⟳ updatescaling Rollout �[32m✔�[0m Healthy 92s
├──# revision:2
│ └──⧉ �[32mupdatescaling-79b6b5f5d4�[0m ReplicaSet �[32m✔�[0m Healthy 91s �[32mstable�[0m
│ ├──□ updatescaling-79b6b5f5d4-7f4mw Pod �[32m✔�[0m Running 91s ready:1/1
│ ├──□ updatescaling-79b6b5f5d4-f7bdq Pod �[32m✔�[0m Running 91s ready:1/1
│ ├──□ updatescaling-79b6b5f5d4-nx4ks Pod �[32m✔�[0m Running 91s ready:1/1
│ └──□ updatescaling-79b6b5f5d4-xpzr9 Pod �[32m✔�[0m Running 91s ready:1/1
└──# revision:1
└──⧉ updatescaling-54d546d75c ReplicaSet �[0m•�[0m ScaledDown 92s
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2024-10-09T18:26:01Z"
generation: 4
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestRolloutWithMaxSurgeScalingDuringUpdate
name: updatescaling
namespace: default
resourceVersion: "10133"
uid: c9bfdb84-a139-41e1-bbbb-3bea199ebc4c
spec:
replicas: 4
selector:
matchLabels:
app: updatescaling
strategy:
canary:
maxSurge: 100%
template:
metadata:
creationTimestamp: null
labels:
app: updatescaling
spec:
containers:
- image: nginx:1.19-alpine
name: updatescaling
resources:
requests:
cpu: 2m
memory: 16Mi
status:
HPAReplicas: 4
availableReplicas: 4
blueGreen: {}
canary: {}
conditions:
- lastTransitionTime: "2024-10-09T18:26:04Z"
lastUpdateTime: "2024-10-09T18:26:04Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2024-10-09T18:26:05Z"
lastUpdateTime: "2024-10-09T18:26:05Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2024-10-09T18:26:05Z"
lastUpdateTime: "2024-10-09T18:26:05Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2024-10-09T18:26:01Z"
lastUpdateTime: "2024-10-09T18:26:05Z"
message: ReplicaSet "updatescaling-79b6b5f5d4" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
currentPodHash: 79b6b5f5d4
currentStepHash: 5ffbfbbd64
observedGeneration: "4"
phase: Healthy
readyReplicas: 4
replicas: 4
selector: app=updatescaling
stableRS: 79b6b5f5d4
updatedReplicas: 4
2024-10-09T18:26:01Z Normal RolloutAddedToInformer Rollout resource added to informer: default/updatescaling
2024-10-09T18:26:01Z Normal RolloutUpdated Rollout updated to revision 1
2024-10-09T18:26:01Z Normal NewReplicaSetCreated Created ReplicaSet updatescaling-54d546d75c (revision 1)
2024-10-09T18:26:01Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (54d546d75c)
2024-10-09T18:26:01Z Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-54d546d75c (revision 1) from 0 to 4
2024-10-09T18:26:01Z Normal RolloutCompleted Rollout completed update to revision 1 (54d546d75c): Initial deploy
2024-10-09T18:26:02Z Normal RolloutUpdated Rollout updated to revision 2
2024-10-09T18:26:02Z Normal NewReplicaSetCreated Created ReplicaSet updatescaling-79b6b5f5d4 (revision 2)
2024-10-09T18:26:02Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (79b6b5f5d4)
2024-10-09T18:26:02Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 4 to 3
2024-10-09T18:26:02Z Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 0 to 4
2024-10-09T18:26:02Z Normal ScalingReplicaSet Scaled up ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 4 to 8
2024-10-09T18:26:03Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-79b6b5f5d4 (revision 2) from 8 to 4
2024-10-09T18:26:03Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 3 to 2
2024-10-09T18:26:04Z Normal ScalingReplicaSet Scaled down ReplicaSet updatescaling-54d546d75c (revision 1) from 2 to 0
2024-10-09T18:26:05Z Normal RolloutCompleted Rollout completed update to revision 2 (79b6b5f5d4): Completed all 0 canary steps
time="2024-10-09T18:27:33Z" level=info msg="Deleting e2e-test-name=TestRolloutWithMaxSurgeScalingDuringUpdate"
time="2024-10-09T18:27:33Z" level=info msg="Deleting e2e-test-name"
--- FAIL: TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate (92.80s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / Published E2E Test Results
1 out of 5 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.29)/junit-e2e-test.xml [took 6m 21s]
Raw output
Failed
=== RUN TestCanarySuite
time="2024-10-09T18:21:12Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (381.79s)
Check notice on line 0 in .github
github-actions / Published E2E Test Results
7 skipped tests found
There are 7 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestStepPluginSuite
Check notice on line 0 in .github
github-actions / Published E2E Test Results
113 tests found
There are 113 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBMesh_PingPong_StableCanary_Update
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelayWithProgressDeadline
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryWithPausedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestNeverScaleDown
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownOnSuccess
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestScaleDownProgressively
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestSpecAndReplicaChangeSameTime
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitInStableDownscaleAfterCanaryAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestStepPluginSuite