You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
looks like current dry run is based on TaskWorker/Actions/DryRunUploader preparing a tarball called dry-run-sandbox.tar.gz and uploading it to crabcache "by name" and then crab submit --dry finds it there (so if a user were to run submit --dry from two tasks at same time, there would be a mess).
Best way to do this in S3 seems to add another objectype and hanlde this like clientlog or twlog, placing it in the task directory of the user, since the taskname is known at the time that all those actions are done.
This requires another change to RESTCache, but then changes to client and DryRunUploader should be very small.
To be tested.
The text was updated successfully, but these errors were encountered:
looks like current dry run is based on TaskWorker/Actions/DryRunUploader preparing a tarball called
dry-run-sandbox.tar.gz
and uploading it to crabcache "by name" and then crab submit --dry finds it there (so if a user were to run submit --dry from two tasks at same time, there would be a mess).Best way to do this in S3 seems to add another objectype and hanlde this like clientlog or twlog, placing it in the task directory of the user, since the taskname is known at the time that all those actions are done.
This requires another change to RESTCache, but then changes to client and DryRunUploader should be very small.
To be tested.
The text was updated successfully, but these errors were encountered: