Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve transparency of the compatibility of stages for the user #69

Open
mdenker opened this issue Jun 6, 2024 · 0 comments
Open

Improve transparency of the compatibility of stages for the user #69

mdenker opened this issue Jun 6, 2024 · 0 comments

Comments

@mdenker
Copy link
Member

mdenker commented Jun 6, 2024

Currently, there are checks that make sure that the current stage gets inputs from the previous stage which are compatible. Incompatible stacking of stages will cause an error. Despite the ability to continue the run with the previously computed results by instead running a compatible stage, it would be nice to have a mechanism that makes the stage configuration more transparent for the user, while not making customization of the pipeline more difficult. Potential mechanisms could be:

  • Tagging/annotating stage outputs, or defining MIME types
  • creating a validator for stages
  • making a dry run option that imitates a run using current options
  • creating feedback to the user on the order of stages being executed
  • make a proxy output of each stage (i.e., "empty" output) to help dry running

Goal:

  • Alert the user of an invalid configuration before the run or receives help in constructing a valid stage configuration
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant