[Failing Test]: StorageApiSinkSchemaUpdateIT fails on Dataflow V1 PostCommit

[Abacn]

What happened?

https://ci-beam.apache.org/view/PostCommit/job/beam_PostCommit_Java_DataflowV1/3394/testReport/

It added 24 tests, all fail.

Do we need all these tests run on Dataflow PostCommit anyway or selected one?

Issue Failure

Failure: Test is continually failing

Issue Priority

Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)

Issue Components

• Component: Python SDK
• Component: Java SDK
• Component: Go SDK
• Component: Typescript SDK
• Component: IO connector
• Component: Beam examples
• Component: Beam playground
• Component: Beam katas
• Component: Website
• Component: Spark Runner
• Component: Flink Runner
• Component: Samza Runner
• Component: Twister2 Runner
• Component: Hazelcast Jet Runner
• Component: Google Cloud Dataflow Runner

[Abacn]

CC: @ahmedabu98

[ahmedabu98]

The GCP IO module doesn't include org.apache.beam:beam-runners-google-cloud-dataflow-java, otherwise we could manually set streaming engine by doing something like:

if (p.getOptions().getRunner().getName().equals(TestDataflowRunner.class.getName())) {
  p.getOptions().as(TestDataflowPipelineOptions.class).setEnableStreamingEngine(true);
}

[ahmedabu98]

I also just remembered, TestDataflowRunner doesn't support TestStream. These tests can be skipped for all dataflow postcommits.

[ahmedabu98]

FYI this is failing on both runners

[Abacn]

I see, runner v2 tests failing for different reason:

java.lang.RuntimeException: Workflow failed. Causes: TestStream use not allowed in this environment.

will update #27928 exclude from both suite