Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

wip: feat: Multiband reader #3

Open
wants to merge 42 commits into
base: dev
Choose a base branch
from
Open

wip: feat: Multiband reader #3

wants to merge 42 commits into from

Commits on May 26, 2021

  1. feat: add banded grid reading processor

    @wphyojpl
    wphyojpl committed May 26, 2021
    Configuration menu
    Copy the full SHA
    61fefad View commit details
    Browse the repository at this point in the history

  2. chore: add more format to granule logger

    @wphyojpl
    wphyojpl committed May 26, 2021
    Configuration menu
    Copy the full SHA
    f7799c9 View commit details
    Browse the repository at this point in the history

  3. chore: add detailed log format for collection manager

    @wphyojpl
    wphyojpl committed May 26, 2021
    Configuration menu
    Copy the full SHA
    783d68a View commit details
    Browse the repository at this point in the history

Commits on May 28, 2021

  1. feat: combine banded grid and grid reading processors

    @wphyojpl
    wphyojpl committed May 28, 2021
    Configuration menu
    Copy the full SHA
    a2e509e View commit details
    Browse the repository at this point in the history

  2. chore: add 1 more test case

    @wphyojpl
    wphyojpl committed May 28, 2021
    Configuration menu
    Copy the full SHA
    5880c81 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2021

  1. fix: handle list value of dict for frozenset in collection + reduce l… 

    …og level to DEBUG
    @wphyojpl
    wphyojpl committed Jun 1, 2021
    Configuration menu
    Copy the full SHA
    5115992 View commit details
    Browse the repository at this point in the history

  2. feat: add log level control from environment variable IS_VERBOSE

    @wphyojpl
    wphyojpl committed Jun 1, 2021
    Configuration menu
    Copy the full SHA
    64615d0 View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2021

  1. fix: convert list to string for frozenset

    @wphyojpl
    wphyojpl committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    1254103 View commit details
    Browse the repository at this point in the history

  2. chore: add log debug statements

    @wphyojpl
    wphyojpl committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    b8455ec View commit details
    Browse the repository at this point in the history

  3. fix: convert str variable back to a list

    @wphyojpl
    wphyojpl committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    ccceff7 View commit details
    Browse the repository at this point in the history

  4. fix: update TileSummarizingProcessor for input list

    @wphyojpl
    wphyojpl committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    918f931 View commit details
    Browse the repository at this point in the history

  5. fix: update GenerateTileId to work with input list

    @wphyojpl
    wphyojpl committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    b94b8d3 View commit details
    Browse the repository at this point in the history

  6. fix: update K2C logic for vectored input

    @wphyojpl
    wphyojpl committed Jun 8, 2021
    Configuration menu
    Copy the full SHA
    d4c978c View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2021

  1. chore: remove outdated log statement

    @wphyojpl
    wphyojpl committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    c463653 View commit details
    Browse the repository at this point in the history

  2. fix: update solr store to work with vectored inputs

    @wphyojpl
    wphyojpl committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    35da07f View commit details
    Browse the repository at this point in the history

  3. fix: accept variable as list or convert to list for vectored inputs

    @wphyojpl
    wphyojpl committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    ac43b39 View commit details
    Browse the repository at this point in the history

  4. chore: add validation to existing reading processors for multiple vec… 

    …tored value. they should be updated later
    @wphyojpl
    wphyojpl committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    ecb647c View commit details
    Browse the repository at this point in the history

  5. fix: need str representation of data_var_name + add exception log

    @wphyojpl
    wphyojpl committed Jun 9, 2021
    Configuration menu
    Copy the full SHA
    50ca62c View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2021

  1. feat: cancelling dimension switches + updating test too. But some are… 

    … failing (WIP)
    @wphyojpl
    wphyojpl committed Jul 9, 2021
    Configuration menu
    Copy the full SHA
    cd2edc4 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2021

  1. feat: allow variable as a string for backward compatibility

    @wphyojpl
    wphyojpl committed Jul 12, 2021
    Configuration menu
    Copy the full SHA
    a2ebedd View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2021

  1. chore: remove log statement

    @wphyojpl
    wphyojpl committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    b730073 View commit details
    Browse the repository at this point in the history

  2. feat: make incoming configmap backward compatible by allowing either … 

    …variable or variables
    @wphyojpl
    wphyojpl committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    5a0ba29 View commit details
    Browse the repository at this point in the history

  3. fix: ignoring RepeatedScalarFieldContainer error

    @wphyojpl
    wphyojpl committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    ce2574e View commit details
    Browse the repository at this point in the history

  4. chore: remove log statements

    @wphyojpl
    wphyojpl committed Jul 13, 2021
    Configuration menu
    Copy the full SHA
    0ae9160 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2021

  1. fix: update test with variable in array as collection will always con… 

    …vert to array
    @wphyojpl
    wphyojpl committed Jul 15, 2021
    Configuration menu
    Copy the full SHA
    7fc8ec6 View commit details
    Browse the repository at this point in the history

  2. chore: add debug log statement to see which processor has started

    @wphyojpl
    wphyojpl committed Jul 15, 2021
    Configuration menu
    Copy the full SHA
    0af5515 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2021

  1. fix: add debugging log + hide error in tile-summarizing

    @wphyojpl
    wphyojpl committed Jul 20, 2021
    Configuration menu
    Copy the full SHA
    6851429 View commit details
    Browse the repository at this point in the history

  2. feat: add 1 more test case for hls pre-processed data

    @wphyojpl
    wphyojpl committed Jul 20, 2021
    Configuration menu
    Copy the full SHA
    43af033 View commit details
    Browse the repository at this point in the history

  3. feat: add multiband for swath reading processor + add test case

    @wphyojpl
    wphyojpl committed Jul 20, 2021
    Configuration menu
    Copy the full SHA
    164ab58 View commit details
    Browse the repository at this point in the history

  4. chore: add todo text

    @wphyojpl
    wphyojpl committed Jul 20, 2021
    Configuration menu
    Copy the full SHA
    9eebb8d View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2021

  1. feat: keep grid & swath reading processor as single band + create 2 n… 

    …ew processors for multiband
    @wphyojpl
    wphyojpl committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    68175f1 View commit details
    Browse the repository at this point in the history

  2. feat: add test cases for 2 new multiband processors

    @wphyojpl
    wphyojpl committed Jul 26, 2021
    Configuration menu
    Copy the full SHA
    58f349b View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2021

  1. feat: use GridMultiBandTile + transpose to 

    [time, lat, lon, bands]
    @wphyojpl
    wphyojpl committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    58a97eb View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2021

  1. feat: update ForceAscendingLatitude to use data_dim_names when possib… 

    …le. defaulting to axis 0 if not
    @wphyojpl
    wphyojpl committed Jul 28, 2021
    Configuration menu
    Copy the full SHA
    0bd4c9d View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2021

  1. feat: make transpose a generic method + update swath multiband processor

    @wphyojpl
    wphyojpl committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    15e033d View commit details
    Browse the repository at this point in the history

  2. chore: reduce details in debug level log

    @wphyojpl
    wphyojpl committed Aug 2, 2021
    Configuration menu
    Copy the full SHA
    8303cd2 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2021

  1. feat: add standard_name from all variable names + update debug statement

    @wphyojpl
    wphyojpl committed Aug 4, 2021
    Configuration menu
    Copy the full SHA
    439c7c7 View commit details
    Browse the repository at this point in the history

  2. chore: change band to variable for grid

    @wphyojpl
    wphyojpl committed Aug 4, 2021
    Configuration menu
    Copy the full SHA
    94fb729 View commit details
    Browse the repository at this point in the history

  3. chore: change swath_multi_variable_tile from swath_multi_band_tile

    @wphyojpl
    wphyojpl committed Aug 4, 2021
    Configuration menu
    Copy the full SHA
    8f54aeb View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2021

  1. fix: make data_var_name a string for backward compatibility

    @wphyojpl
    wphyojpl committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    b09d29b View commit details
    Browse the repository at this point in the history

  2. chore: update band to variable for a more general purpose

    @wphyojpl
    wphyojpl committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    25e30d8 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2021

  1. chore: use apache protobuf repo + add SwathMultiVariableReadingProces… 

    …sor to init file
    @wphyojpl
    wphyojpl committed Aug 11, 2021
    Configuration menu
    Copy the full SHA
    e7552d3 View commit details
    Browse the repository at this point in the history