Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add Data Access Token vending in OpenHouse #242

Open
1 of 8 tasks
raymondlam12 opened this issue Oct 29, 2024 · 0 comments
Open
1 of 8 tasks

[Feature] Add Data Access Token vending in OpenHouse #242

raymondlam12 opened this issue Oct 29, 2024 · 0 comments
Labels
feat New feature or request

Comments

@raymondlam12
Copy link

Willingness to contribute

{"label"=>"Yes. I can contribute a fix for this bug independently.", "value"=>"independent"}

Feature Request Proposal

Cloud blob storage providers like AWS and Azure have "data access token", tokens that provide authorized access to S3 storage / Azure Blob Storage, support via AWS S3 Access Grants and Azure Shared Access Signatures respectively.

As a catalog, OpenHouse can vend these "data access tokens" for accessing storage to a specific table and users would subsequently leverage these credentials to access their storage.

Motivation

What is the use case for this feature?

This would put OpenHouse in the data access control place and remove the need to synchronize data access control with underlying blob storage.

What component(s) does this feature affect?

  • Table Service: This is the RESTful catalog service that stores table metadata. :services:tables
  • Jobs Service: This is the job orchestrator that submits data services for table maintenance. :services:jobs
  • Data Services: This is the jobs that performs table maintenance. apps:spark
  • Iceberg internal catalog: This is the internal Iceberg catalog for OpenHouse Catalog Service. :iceberg:openhouse
  • Spark Client Integration: This is the Apache Spark integration for OpenHouse catalog. :integration:spark
  • Documentation: This is the documentation for OpenHouse. docs
  • Local Docker: This is the local Docker environment for OpenHouse. infra/recipes/docker-compose
  • Other: Please specify the component.

Details

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant