Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] CRD Schema updates #78

Open
george-zubrienko opened this issue Nov 7, 2024 · 0 comments
Open

[FEATURE] CRD Schema updates #78

george-zubrienko opened this issue Nov 7, 2024 · 0 comments
Labels
code/new-feature New feature or request

Comments

@george-zubrienko
Copy link
Contributor

Description

Plugin re-write adds some capabilities that require CRD change. New fields to add:

  • stagingLocation: path to save staging Iceberg tables to
  • targetLocation: path to save/merge staging table data into
  • retention.period: period in hours to keep the staging data for
  • retention.location: location of an archive table for the stream staging data
  • catalog.authSecret: authentication information for the data catalog used by MergeStage
  • merge.authSecret: authentication information for the merge service
  • storage.authSecret: authentication information for the staging/target storage
  • postCommitHooks: an array of class paths for post hooks, i.e. PolarisPublishHook

Possible solution

No response

Alternatives

No response

Context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code/new-feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant