Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add ability for non-lazy reprojection to write to a sharded fits #678

Closed
maxwest-uw opened this issue Aug 5, 2024 · 0 comments · Fixed by #683
Closed

add ability for non-lazy reprojection to write to a sharded fits #678

maxwest-uw opened this issue Aug 5, 2024 · 0 comments · Fixed by #683
Assignees

Comments

@maxwest-uw
Copy link
Collaborator

should support #622

If we want to ensure that reprojection can be handled by one function call, we should add the functionality to have a parallel reprojection output the result as a sharded fits. Right now, this functionality is only available to an already sharded fits loaded with lazy=True, but for certain work flows we shouldn't have to write out an intermediary WorkUnit just to run reprojection. It is still worth it imo to write the final result to a sharded WorkUnit instead of pickling+unpickling it in serial after reprojection, as reading it from disk after reprojection is significantly faster.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant