As a user, I want to force an upload of file that is already in S3 or the Registry

[jordanpadams]

Checked for duplicates

Yes - I've already checked

🧑‍🔬 User Persona(s)

Node Operator

💪 Motivation

...so that I can overwrite data that has already been loaded into the PDC

📖 Additional Details

No response

Acceptance Criteria

Given a file that has already been loaded into the registry
When I perform a DUM upload with the --overwrite flag enabled
Then I expect the data to overwrite the existing file in the system, and DUM to note that this occurred in the logs

⚙️ Engineering Details

No response

[tloubrieu-jpl]

from the breakout meeting today:
The API need to provide a simple end-point for DUM to retrieve files, critical information to provide is:

file name/path
discipline node
md5sum

We are not sure yet what the best key should provided by the API, either:

option1: node + file path → returns md5sum, lidvid
option2: md5sum → returns node, file path and lidvid

With option 1, a new end-point for the API could be:

/files/{node}/{file_path} which would return the {md5sum} 

The issue is that the file_path is not always the same, on the staging bucket or where the file is archived eventually. 

@ramesh-maddegoda, @viviant100 could you investigate how the path on the archive bucket (ODR) is being created from the path in the staging bucket ?

[tloubrieu-jpl]

Waiting for Jordan for validation

[tloubrieu-jpl]

Validated with endpoint /files/{md5sum} to be developed in the API.