Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Exclude StorageApiSinkSchemaUpdate integration tests from dataflow postcommit #27928

Merged
merged 2 commits into from
Aug 9, 2023

Conversation

Abacn
Copy link
Contributor

@Abacn Abacn commented Aug 9, 2023

Fixes #27911

We also did similar exclusions for various IO tests on legacy runner (see code around)

Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI or the workflows README to see a list of phrases to trigger workflows.

@Abacn
Copy link
Contributor Author

Abacn commented Aug 9, 2023

R: @ahmedabu98 @reuvenlax

@Abacn
Copy link
Contributor Author

Abacn commented Aug 9, 2023

Run PostCommit_Java_Dataflow

@github-actions
Copy link
Contributor

github-actions bot commented Aug 9, 2023

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control

@@ -556,6 +556,7 @@ task googleCloudPlatformLegacyWorkerIntegrationTest(type: Test, dependsOn: copyG
include '**/*IT.class'
exclude '**/BigQueryIOReadIT.class'
exclude '**/BigQueryIOStorageReadTableRowIT.class'
exclude '**/StorageApiSinkSchemaUpdateIT.class'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add a comment mentioning this is due to the test needing streaming engine?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@reuvenlax
Copy link
Contributor

reuvenlax commented Aug 9, 2023 via email

@reuvenlax
Copy link
Contributor

@ ahmedabu98 virtually all users are running this sink on runner v1 today, so it would be good to get it working.

@ahmedabu98
Copy link
Contributor

Commented on the issue but mentioning here too:

This may need some refactoring because I believe TestDataflowRunner doesn't support TestStream

@Abacn
Copy link
Contributor Author

Abacn commented Aug 9, 2023

Run PostCommit_Java_Dataflow

@Abacn
Copy link
Contributor Author

Abacn commented Aug 9, 2023

Run PostCommit_Java_DataflowV2

@Abacn
Copy link
Contributor Author

Abacn commented Aug 9, 2023

The refactoring is of course good; can we get this in so postcommit back green first, giving that failing tests are newly added so do not signature functioning issue @ahmedabu98 CC: @lostluck

@Abacn Abacn changed the title Exclude StorageApiSinkSchemaUpdate integration tests from runner v1 postcommit Exclude StorageApiSinkSchemaUpdate integration tests from dataflow postcommit Aug 9, 2023
@Abacn Abacn merged commit 0a7b999 into apache:master Aug 9, 2023
14 of 15 checks passed
@Abacn Abacn deleted the excludeitv1 branch August 23, 2023 16:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Failing Test]: StorageApiSinkSchemaUpdateIT fails on Dataflow V1 PostCommit
4 participants