Skip to content

UI Overhaul and S2 Batch Downloads

Compare
Choose a tag to compare
@wscullen wscullen released this 22 Apr 10:13
· 4 commits to sen2agri_tasks since this release

What's new:

  • User account and login are now required to use the backend API (eventually there will be a registration page, but for now email me and I will create accounts with your preferred email address)
  • UI overhaul using the Semantic UI library
  • Additional vector files can be added for visualization
  • Downloads are handled using batch jobs now, which has implications such as:
    • Emails are sent to the user who submits the job, once on job start and once when completed
    • Individual celery tasks associated with the overall batch job now update their progress, that information is surfaced in the tile list as a green progress bar under the tile cell
    • If any one of the individual celery tasks fails, the overall job is marked as failed, but any successful celery tasks will still store their results on the S3, so a subsequent retry will be completed faster
  • Map layers for visualization can be toggled on and off, and MGRS and WRS grid layers are auto toggled depending on which platform is selected (Landsat 8 or Sentinel 2)

What's broken:

  • LTA (long term archive) interaction in the ESA Scihub API has been inconsistent and difficult to test, for now stick to dates after Sept 2019 (this is actively being worked on)
  • Landsat 8 downloads haven't been updated to match the batch download structure used by Sentinel 2, so for now please test with the Sentinel 2 platform only (this is actively being worked on, will be ready shortly using the Sentinel 2 methods as a template)
  • Downloads for individual tiles, the retry button, and info buttons are still non-functional
  • Sen2Agri tasks require further testing. L2A creation works but is not fully tested. L3B creation does not work on the backend but has a prototype GUI on the front end. L3A has no GUI and does not work on the backend. This will be addressed after the Landsat 8 download functionality reaches parity with the Sentinel 2 functionality
  • If the app has a white screen after updating, make sure to:
    • Clear Cache
    • Clear local storage
    • Exit the application and restart it

What's coming:

  • New download options using Google Cloud storage or Google Earth Engine python API instead of the ESA and USGS APIs
  • Timeline viewer is still coming!
  • Functioning download and retry buttons!
  • Lots more stuff that I can't think of!