Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/add error handling for bqio #30081

Merged
merged 17 commits into from
Feb 21, 2024
Merged

Feature/add error handling for bqio #30081

merged 17 commits into from
Feb 21, 2024

Commits on Jan 22, 2024

  1. initial work on bqio dlq

    @johnjcasey
    johnjcasey committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    78a7444 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. add test for exception handling on bq

    @johnjcasey
    johnjcasey committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    7597a60 View commit details
    Browse the repository at this point in the history

  2. add tests

    @johnjcasey
    johnjcasey committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    c09cacc View commit details
    Browse the repository at this point in the history

  3. add trigger file to force the postcommit

    @johnjcasey
    johnjcasey committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    c7ad419 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. wire error handling into storage write, update check to not log a war… 

    …ning if errorhandler is used but error output isn't consumed.
    @johnjcasey
    johnjcasey committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    983b135 View commit details
    Browse the repository at this point in the history

  2. wire batch loads with error handler

    @johnjcasey
    johnjcasey committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    06f9096 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. wire in batch loads changes, update tests

    @johnjcasey
    johnjcasey committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    df375df View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. add BQ write with error handling test cases

    @johnjcasey
    johnjcasey committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    f001a04 View commit details
    Browse the repository at this point in the history

  2. spotless

    @johnjcasey
    johnjcasey committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    921793b View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. Merge branch 'apache:master' into feature/add-error-handling-for-bqio

    @johnjcasey
    johnjcasey authored Feb 13, 2024
    Configuration menu
    Copy the full SHA
    5130b38 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. add trigger files

    @johnjcasey
    johnjcasey committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    e5c53fe View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/feature/add-error-handling-for-b… 

    …qio' into feature/add-error-handling-for-bqio
    @johnjcasey
    johnjcasey committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    27ad361 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. Merge remote-tracking branch 'origin/master' into feature/add-error-h… 

    …andling-for-bqio

# Conflicts:
#	sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOTranslation.java
    @johnjcasey
    johnjcasey committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    a2e4b50 View commit details
    Browse the repository at this point in the history

  2. address comments, support error handling when direct read from table

    @johnjcasey
    johnjcasey committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    c6fb18b View commit details
    Browse the repository at this point in the history

  3. revert change to build.gradle

    @johnjcasey
    johnjcasey committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    c886de1 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. address comments, improve splitting logic

    @johnjcasey
    johnjcasey committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    f78a73f View commit details
    Browse the repository at this point in the history

  2. spotless

    @johnjcasey
    johnjcasey committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    47fce17 View commit details
    Browse the repository at this point in the history