Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update wekeo configuration following API changes #1371

Open
amarandon opened this issue Oct 25, 2024 · 0 comments · May be fixed by #1392
Open

Update wekeo configuration following API changes #1371

amarandon opened this issue Oct 25, 2024 · 0 comments · May be fixed by #1392
Assignees
@amarandon
Labels
bug Something isn't working dedl DEDL related

Comments

@amarandon
Copy link
Collaborator

Another problem with FIRE_HISTORICAL via wekeo_ecmwf:

{"status_code":500,"title":"Search Product","detail":"Required param data_format missing"}

Wekeo's AI assistant is telling me this:

ECMWF datasets have recently transitioned to new platforms, which include changes like replacing the 'format' parameter with 'data_format'.

I tried setting the parameter when doing the search:

search_result = dag.search(
    start="2016-03-01T00:00:00Z", end="2016-04-02T00:00:00Z",
    provider="wekeo_ecmwf", productType="FIRE_HISTORICAL",
    data_format="netcdf",
)

But it's not included in the query params:

2024-10-24 16:50:13,072 eodag.search.qssearch            [DEBUG   ] Query parameters:
{'dataset_id': 'EO:ECMWF:DAT:CEMS_FIRE_HISTORICAL_V1', 'year': ['2016'], 'month': ['03'], 'day': ['01'],
'product_type': 'reanalysis', 'variable': ['fire_danger_index'], 'system_version': ['4_1'], 'format': ['grib'],
'grid': 'original_grid', 'dataset_type': 'consolidated_dataset', 'itemsPerPage': 20, 'startIndex': 0}

I also tried updating the configuration of the product FIRE_HISTORICAL for the provider wekeo_ecmwf like this:

    FIRE_HISTORICAL:
      productType: EO:ECMWF:DAT:CEMS_FIRE_HISTORICAL_V1
      providerProductType: reanalysis
      variable:
        - fire_danger_index
      version:
        - "4_1"
      data_format:
        - "grib"
        - "netcdf"
      # format:
      #   - "grib"

But data_format is not included in the request (note that in this case format is also removed):

2024-10-24 16:38:11,210 eodag.search.qssearch            [DEBUG   ] Query parameters:
{'dataset_id': 'EO:ECMWF:DAT:CEMS_FIRE_HISTORICAL_V1', 'year': ['2016'], 'month': ['03'], 'day': ['01'],
'product_type': 'reanalysis', 'variable': ['fire_danger_index'], 'system_version': ['4_1'], 'grid': 'original_grid',
'dataset_type': 'consolidated_dataset', 'itemsPerPage': 20, 'startIndex': 0}

Additional info from @jlahovnik :

If the parameter name has changed you have to update the metadata mapping of the provider:
image
If you update this mapping to '{{"data_format": ...}}, you don't have to update all the default values of the product types.
@amarandon amarandon added the bug Something isn't working label Oct 25, 2024
@amarandon amarandon self-assigned this Oct 25, 2024
@amarandon amarandon linked a pull request Nov 7, 2024 that will close this issue
1371 update wekeo configuration following api changes #1392
Open
@amarandon amarandon added the dedl DEDL related label Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@amarandon amarandon

Labels
bug Something isn't working dedl DEDL related
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

1371 update wekeo configuration following api changes CS-SI/eodag
1 participant
@amarandon