Skip to content

Commit

Permalink
Drop Flink 1.16 support
Browse files Browse the repository at this point in the history
  • Loading branch information
kennknowles committed Oct 17, 2024
1 parent 161ccaa commit 3c2a76d
Show file tree
Hide file tree
Showing 12 changed files with 8 additions and 290 deletions.
2 changes: 1 addition & 1 deletion CHANGES.md
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@

## Deprecations

* Removed support for Flink 1.15
* Removed support for Flink 1.15 and 1.16
* X behavior is deprecated and will be removed in X versions ([#X](https://github.com/apache/beam/issues/X)).

## Bugfixes
Expand Down
2 changes: 1 addition & 1 deletion gradle.properties
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,6 @@ docker_image_default_repo_root=apache
docker_image_default_repo_prefix=beam_

# supported flink versions
flink_versions=1.16,1.17,1.18,1.19
flink_versions=1.17,1.18,1.19
# supported python versions
python_versions=3.8,3.9,3.10,3.11,3.12
Original file line number Diff line number Diff line change
Expand Up @@ -191,7 +191,7 @@ $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \
{{if (eq .Sdk "java")}}

##### Portable
1. Starting with Beam 2.18.0, pre-built Flink Job Service Docker images are available at Docker Hub: `Flink 1.16`, `Flink 1.17`, `Flink 1.18`, `Flink 1.19`.
1. Starting with Beam 2.18.0, pre-built Flink Job Service Docker images are available at Docker Hub: `Flink 1.17`, `Flink 1.18`, `Flink 1.19`.
2. Start the JobService endpoint: `docker run --net=host apache/beam_flink1.19_job_server:latest`
3. Submit the pipeline to the above endpoint by using the PortableRunner, job_endpoint set to localhost:8099 (this is the default address of the JobService). Optionally set environment_type set to LOOPBACK. For example:

Expand Down Expand Up @@ -233,7 +233,7 @@ mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
{{end}}

{{if (eq .Sdk "python")}}
1. Starting with Beam 2.18.0, pre-built Flink Job Service Docker images are available at Docker Hub: `Flink 1.16`, `Flink 1.17`, `Flink 1.18`, `Flink 1.19`.
1. Starting with Beam 2.18.0, pre-built Flink Job Service Docker images are available at Docker Hub: `Flink 1.17`, `Flink 1.18`, `Flink 1.19`.
2. Start the JobService endpoint: `docker run --net=host apache/beam_flink1.19_job_server:latest`
3. Submit the pipeline to the above endpoint by using the PortableRunner, job_endpoint set to localhost:8099 (this is the default address of the JobService). Optionally set environment_type set to LOOPBACK. For example:

Expand Down
25 changes: 0 additions & 25 deletions runners/flink/1.16/build.gradle

This file was deleted.

26 changes: 0 additions & 26 deletions runners/flink/1.16/job-server-container/build.gradle

This file was deleted.

31 changes: 0 additions & 31 deletions runners/flink/1.16/job-server/build.gradle

This file was deleted.

This file was deleted.

2 changes: 1 addition & 1 deletion sdks/typescript/src/apache_beam/runners/flink.ts
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ import { JavaJarService } from "../utils/service";
const MAGIC_HOST_NAMES = ["[local]", "[auto]"];

// These should stay in sync with gradle.properties.
const PUBLISHED_FLINK_VERSIONS = ["1.16", "1.17", "1.18", "1.19"];
const PUBLISHED_FLINK_VERSIONS = ["1.17", "1.18", "1.19"];

const defaultOptions = {
flinkMaster: "[local]",
Expand Down
4 changes: 0 additions & 4 deletions settings.gradle.kts
Original file line number Diff line number Diff line change
Expand Up @@ -125,10 +125,6 @@ include(":runners:extensions-java:metrics")
* verify versions in website/www/site/content/en/documentation/runners/flink.md
* verify version in sdks/python/apache_beam/runners/interactive/interactive_beam.py
*/
// Flink 1.16
include(":runners:flink:1.16")
include(":runners:flink:1.16:job-server")
include(":runners:flink:1.16:job-server-container")
// Flink 1.17
include(":runners:flink:1.17")
include(":runners:flink:1.17:job-server")
Expand Down
7 changes: 3 additions & 4 deletions website/www/site/content/en/documentation/runners/flink.md
Original file line number Diff line number Diff line change
Expand Up @@ -196,7 +196,6 @@ The optional `flink_version` option may be required as well for older versions o

{{< paragraph class="language-portable" >}}
Starting with Beam 2.18.0, pre-built Flink Job Service Docker images are available at Docker Hub:
[Flink 1.16](https://hub.docker.com/r/apache/beam_flink1.16_job_server).
[Flink 1.17](https://hub.docker.com/r/apache/beam_flink1.17_job_server).
[Flink 1.18](https://hub.docker.com/r/apache/beam_flink1.18_job_server).
[Flink 1.19](https://hub.docker.com/r/apache/beam_flink1.19_job_server).
Expand Down Expand Up @@ -312,8 +311,8 @@ reference.
## Flink Version Compatibility

The Flink cluster version has to match the minor version used by the FlinkRunner.
The minor version is the first two numbers in the version string, e.g. in `1.16.0` the
minor version is `1.16`.
The minor version is the first two numbers in the version string, e.g. in `1.19.0` the
minor version is `1.19`.

We try to track the latest version of Apache Flink at the time of the Beam release.
A Flink version is supported by Beam for the time it is supported by the Flink community.
Expand Down Expand Up @@ -344,7 +343,7 @@ To find out which version of Flink is compatible with Beam please see the table
<tr>
<td>1.16.x</td>
<td>beam-runners-flink-1.16</td>
<td>&ge; 2.47.0</td>
<td>2.47.0 - 2.60.0</td>
</tr>
<tr>
<td>1.15.x</td>
Expand Down

0 comments on commit 3c2a76d

Please sign in to comment.