-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable drain operation for flink jobs with requiresStableInput annotation #28567
Commits on Sep 20, 2023
-
skip watermark hold check for requiresStableInput operator
Kanishk Karanawat committedSep 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 911550e - Browse repository at this point
Copy the full SHA 911550eView commit details -
Kanishk Karanawat committed
Sep 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 9107277 - Browse repository at this point
Copy the full SHA 9107277View commit details -
Kanishk Karanawat committed
Sep 20, 2023 Configuration menu - View commit details
-
Copy full SHA for e6ff225 - Browse repository at this point
Copy the full SHA e6ff225View commit details
Commits on Oct 11, 2023
-
flush buffer when requiresStableInput is set
Kanishk Karanawat committedOct 11, 2023 Configuration menu - View commit details
-
Copy full SHA for db67dfa - Browse repository at this point
Copy the full SHA db67dfaView commit details
Commits on Oct 18, 2023
-
Kanishk Karanawat committed
Oct 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 65b2dcf - Browse repository at this point
Copy the full SHA 65b2dcfView commit details -
add flag in FlinkPipelineOptions to allow draining for pipelines with…
… RequiresStableInput
Kanishk Karanawat committedOct 18, 2023 Configuration menu - View commit details
-
Copy full SHA for 4ca8d3a - Browse repository at this point
Copy the full SHA 4ca8d3aView commit details -
Configuration menu - View commit details
-
Copy full SHA for e5626b7 - Browse repository at this point
Copy the full SHA e5626b7View commit details
Commits on Oct 19, 2023
-
Kanishk Karanawat committed
Oct 19, 2023 Configuration menu - View commit details
-
Copy full SHA for 897d5a3 - Browse repository at this point
Copy the full SHA 897d5a3View commit details
Commits on Oct 21, 2023
-
Implement java exponential histograms (apache#28903) (apache#28995)
* Implement java exponential histograms (apache#28903) * Address comments * Address comments
Configuration menu - View commit details
-
Copy full SHA for 10b8d10 - Browse repository at this point
Copy the full SHA 10b8d10View commit details -
Adjust a schedule to run workflows in subgroups (apache#29049)
* cron time update * cron fix
Configuration menu - View commit details
-
Copy full SHA for 8c4ce51 - Browse repository at this point
Copy the full SHA 8c4ce51View commit details -
Disable comment trigger for Performance and Load Tests (apache#29035)
* reference PR 28915 issue_comment removed * post commit issue_comment fix * revert changes for postcommit
Configuration menu - View commit details
-
Copy full SHA for 0aa9020 - Browse repository at this point
Copy the full SHA 0aa9020View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f0a07f - Browse repository at this point
Copy the full SHA 1f0a07fView commit details -
Add link to the Dataflow service options page (apache#29068)
* Add link to the Dataflow service options page * Fix link format * Small text edit
Configuration menu - View commit details
-
Copy full SHA for bffeefc - Browse repository at this point
Copy the full SHA bffeefcView commit details -
Arc network update (apache#29058)
* Update arc terraform to allow for coloaction in the default network.Allow usage of reserved ip. Allow usage of existing SA * sync beam env * move aditional runners to load based scaling
Configuration menu - View commit details
-
Copy full SHA for f28009d - Browse repository at this point
Copy the full SHA f28009dView commit details -
Configuration menu - View commit details
-
Copy full SHA for bbafe74 - Browse repository at this point
Copy the full SHA bbafe74View commit details -
Configuration menu - View commit details
-
Copy full SHA for 938e64e - Browse repository at this point
Copy the full SHA 938e64eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3d6bb98 - Browse repository at this point
Copy the full SHA 3d6bb98View commit details -
Configuration menu - View commit details
-
Copy full SHA for 26228fc - Browse repository at this point
Copy the full SHA 26228fcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 012eb1c - Browse repository at this point
Copy the full SHA 012eb1cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8145d3c - Browse repository at this point
Copy the full SHA 8145d3cView commit details -
Add 'release/trigger_all_tests.json' to trigger path of mass comment …
…PR (apache#29064) * Add 'release/trigger_all_tests.json' to trigger path of mass comment PR * Create GItHub Action PreCommit * Create missing Google-ads IO PreCommit * Create missing RequestResponse IO PreCommit * fix leftover * Fix leftover in phrase * Update contributor-docs/release-guide.md Co-authored-by: Danny McCormick <[email protected]> --------- Co-authored-by: Danny McCormick <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 27f701b - Browse repository at this point
Copy the full SHA 27f701bView commit details -
Bump cloud.google.com/go/profiler from 0.3.1 to 0.4.0 in /sdks (apach…
…e#29070) Bumps [cloud.google.com/go/profiler](https://github.com/googleapis/google-cloud-go) from 0.3.1 to 0.4.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@talent/v0.3.1...v0.4.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/profiler dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for cb37c64 - Browse repository at this point
Copy the full SHA cb37c64View commit details -
Move Java Google BOM to best effort post-release task (apache#29062)
* Move Java Google BOM to best effort post-release task * Wording
Configuration menu - View commit details
-
Copy full SHA for 45fb757 - Browse repository at this point
Copy the full SHA 45fb757View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9e6beca - Browse repository at this point
Copy the full SHA 9e6becaView commit details -
make BeamKafkaTable.createKafkaRead to be protected, and we can overr…
…ide it appending options to KafkaIO.Read (apache#29051)
Configuration menu - View commit details
-
Copy full SHA for 7ab4879 - Browse repository at this point
Copy the full SHA 7ab4879View commit details -
Configuration menu - View commit details
-
Copy full SHA for 09035c9 - Browse repository at this point
Copy the full SHA 09035c9View commit details -
Refactor StateFetcher (apache#28755)
Refactor and cleanup of StateFetcher in preparation for future changes
Configuration menu - View commit details
-
Copy full SHA for 247b26a - Browse repository at this point
Copy the full SHA 247b26aView commit details -
Bump google.golang.org/api from 0.147.0 to 0.148.0 in /sdks (apache#2…
…9086) Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.147.0 to 0.148.0. - [Release notes](https://github.com/googleapis/google-api-go-client/releases) - [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md) - [Commits](googleapis/google-api-go-client@v0.147.0...v0.148.0) --- updated-dependencies: - dependency-name: google.golang.org/api dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for b7c5d6b - Browse repository at this point
Copy the full SHA b7c5d6bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1ec8d9f - Browse repository at this point
Copy the full SHA 1ec8d9fView commit details -
beam_performance_singlestoreio (apache#28986)
* beam_performance_singlestoreio * Update .github/workflows/beam_PerformanceTests_SingleStoreIO.yml Add coment about the test-argumets-action Co-authored-by: Andrey Devyatkin <[email protected]> * remove fail-fast and remove comment line in config * config cleanup * influx creds and move to main pool --------- Co-authored-by: Andrey Devyatkin <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 81a99d3 - Browse repository at this point
Copy the full SHA 81a99d3View commit details -
Setup Java 21 container (apache#28918)
* Setup Java 21 container (apache#28833) * Add Java21 container * fix spotless * Update website * Fix jamm * align configs in recent change * incremental fixes * add more comments for when jpms test enabled
Configuration menu - View commit details
-
Copy full SHA for 6c3cca4 - Browse repository at this point
Copy the full SHA 6c3cca4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2c7310f - Browse repository at this point
Copy the full SHA 2c7310fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 89c5380 - Browse repository at this point
Copy the full SHA 89c5380View commit details -
Fix various issues in SplunkIO (apache#28825)
* Fix GZIP compression in HttpEventPublisher. * Add checks to make sure the provided URL is valid. * Fix issue with DefaultCoder in AutoValue generated classes. * Add support for Splunk `fields` metadata. Also fix Coder issues for SplunkEvent. * Address comments.
Configuration menu - View commit details
-
Copy full SHA for ce840a5 - Browse repository at this point
Copy the full SHA ce840a5View commit details -
Refactor prepare arguments step for Github actions (apache#29090)
* Refactor prepare arguments step * Rename perf/load/ pipeline options folders
Configuration menu - View commit details
-
Copy full SHA for fc9d474 - Browse repository at this point
Copy the full SHA fc9d474View commit details -
[YAML] Improved pipeline schema definition. (apache#29083)
Slightly stricter definitions for catching more errors, as well as avoding the use of anyOf which often makes it difficult to deduce what the true error is. This does mean a pipeline must have a transform (or source/sink) block rather than simply be itself a list of transforms.
Configuration menu - View commit details
-
Copy full SHA for 59de1ff - Browse repository at this point
Copy the full SHA 59de1ffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 17df84b - Browse repository at this point
Copy the full SHA 17df84bView commit details -
Merge pull request apache#29093 [YAML] Don't require redundant input …
…for YamlTransform.
Configuration menu - View commit details
-
Copy full SHA for 9858544 - Browse repository at this point
Copy the full SHA 9858544View commit details -
Configuration menu - View commit details
-
Copy full SHA for efe00ec - Browse repository at this point
Copy the full SHA efe00ecView commit details -
Validate incoming JSON data from pubsub.
As well as good practice, not doing so may result in much more obscure errors (e.g. during encoding) downstream.
Configuration menu - View commit details
-
Copy full SHA for 872ec58 - Browse repository at this point
Copy the full SHA 872ec58View commit details -
Configuration menu - View commit details
-
Copy full SHA for a1e5fff - Browse repository at this point
Copy the full SHA a1e5fffView commit details -
Configuration menu - View commit details
-
Copy full SHA for 60ff61d - Browse repository at this point
Copy the full SHA 60ff61dView commit details -
Add workflows to README (apache#29096)
* Add readme for PerformanceTests TextIOIT, JDBC, Kafka IO, SpannerIO, SQLBigQueryIO and BiqQueryIO Python * Update readme * PRs 28582 28584 28606 28581 * PR 28738 LoadTests_Java_GBK_Dataflow * Add readme for PostCommit Java Examples Dataflow V2 * Add readme for LoadTests Java CoGBK * Add readme for LoadTests Python CoGBK Dataflow * Add readme for LoadTests Python ParDo and SideInput * Add readme for LoadTests Smoke Python and Java * Update Readme * Update Readme * updated README * Update readme for Performance Tests BigQueryIO Write Python Batch * Remove Trigger Phrases for Load Tests and Performance tests * PR 28846 28730 28827 28861 28897 * update readme --------- Co-authored-by: aleksandr-dudko <[email protected]> Co-authored-by: vitaly.terentyev <[email protected]> Co-authored-by: magicgoody <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 2902462 - Browse repository at this point
Copy the full SHA 2902462View commit details -
Bump cloud.google.com/go/spanner from 1.50.0 to 1.51.0 in /sdks (apac…
…he#29046) Bumps [cloud.google.com/go/spanner](https://github.com/googleapis/google-cloud-go) from 1.50.0 to 1.51.0. - [Release notes](https://github.com/googleapis/google-cloud-go/releases) - [Changelog](https://github.com/googleapis/google-cloud-go/blob/main/CHANGES.md) - [Commits](googleapis/google-cloud-go@spanner/v1.50.0...spanner/v1.51.0) --- updated-dependencies: - dependency-name: cloud.google.com/go/spanner dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for edbc12f - Browse repository at this point
Copy the full SHA edbc12fView commit details -
Bump golang.org/x/net from 0.7.0 to 0.17.0 in /learning/katas/go (apa…
…che#28947) Bumps [golang.org/x/net](https://github.com/golang/net) from 0.7.0 to 0.17.0. - [Commits](golang/net@v0.7.0...v0.17.0) --- updated-dependencies: - dependency-name: golang.org/x/net dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for b247ff0 - Browse repository at this point
Copy the full SHA b247ff0View commit details -
Include ID and name of tracked thread in lull message (apache#29007)
In order to aid debugging of lulls.
Configuration menu - View commit details
-
Copy full SHA for 0a44a2b - Browse repository at this point
Copy the full SHA 0a44a2bView commit details -
flush buffer during drain operation for requiresStableInput operator
correct log message format apply spotless flush buffer when requiresStableInput is set re-organize imports add flag in FlinkPipelineOptions to allow draining for pipelines with RequiresStableInput apply spotless again
Kanishk Karanawat committedOct 21, 2023 Configuration menu - View commit details
-
Copy full SHA for e08578a - Browse repository at this point
Copy the full SHA e08578aView commit details