Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Finalize recipe (+ test new rclone copy stage) #1

Open
wants to merge 33 commits into
base: main
Choose a base branch
from
Open

Finalize recipe (+ test new rclone copy stage) #1

wants to merge 33 commits into from

Commits on Oct 17, 2024

  1. Test recipe

    @jbusecke
    jbusecke committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    a5370cf View commit details
    Browse the repository at this point in the history

  2. Ready to test dataflow

    @jbusecke
    jbusecke committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    8ef1232 View commit details
    Browse the repository at this point in the history

  3. Update recipe.py

    @jbusecke
    jbusecke authored Oct 17, 2024
    Configuration menu
    Copy the full SHA
    5251d62 View commit details
    Browse the repository at this point in the history

  4. Full date range

    @jbusecke
    jbusecke authored Oct 17, 2024
    Configuration menu
    Copy the full SHA
    a19597c View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. Update recipe.py

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    8c3b0a9 View commit details
    Browse the repository at this point in the history

  2. Update requirements.txt

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    07c0bfd View commit details
    Browse the repository at this point in the history

  3. Update requirements.txt

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    72f86c8 View commit details
    Browse the repository at this point in the history

  4. Update requirements.txt

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    3e17987 View commit details
    Browse the repository at this point in the history

  5. Update requirements.txt

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    4f0d239 View commit details
    Browse the repository at this point in the history

  6. Update recipe.py

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    e203a41 View commit details
    Browse the repository at this point in the history

  7. Update recipe.py

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    7410be1 View commit details
    Browse the repository at this point in the history

  8. Update recipe.py

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    eab1ce6 View commit details
    Browse the repository at this point in the history

  9. Update config_dataflow.py

    @jbusecke
    jbusecke authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    ec1f52d View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Update catalog.yaml

    @jbusecke
    jbusecke authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    7934492 View commit details
    Browse the repository at this point in the history

  2. Update recipe.py

    @jbusecke
    jbusecke authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    622fd1e View commit details
    Browse the repository at this point in the history

  3. Update recipe.py

    @jbusecke
    jbusecke authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    c78daf4 View commit details
    Browse the repository at this point in the history

  4. Update recipe.py

    @jbusecke
    jbusecke authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    07fdfcb View commit details
    Browse the repository at this point in the history

  5. Update recipe.py

    @jbusecke
    jbusecke authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    66754bd View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Update config_dataflow.py

    @jbusecke
    jbusecke authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    687649b View commit details
    Browse the repository at this point in the history

  2. Update config_dataflow.py

    @jbusecke
    jbusecke authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    a903a3b View commit details
    Browse the repository at this point in the history

  3. Update config_dataflow.py

    @jbusecke
    jbusecke authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    7cf6564 View commit details
    Browse the repository at this point in the history

  4. Update recipe.py

    @jbusecke
    jbusecke authored Oct 28, 2024
    Configuration menu
    Copy the full SHA
    39d5458 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. bump beam & change config

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    23d4a82 View commit details
    Browse the repository at this point in the history

  2. version conflight

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    d9006af View commit details
    Browse the repository at this point in the history

  3. wip

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    dab46d7 View commit details
    Browse the repository at this point in the history

  4. wip

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    95dbe6f View commit details
    Browse the repository at this point in the history

  5. wip

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    b6e151c View commit details
    Browse the repository at this point in the history

  6. chunking update

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    5135711 View commit details
    Browse the repository at this point in the history

  7. downgrade beam

    @norlandrhagen
    norlandrhagen committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    8894564 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. update local hub config

    @norlandrhagen
    norlandrhagen committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    8289fbb View commit details
    Browse the repository at this point in the history

  2. chunk

    @norlandrhagen
    norlandrhagen committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    0462ddb View commit details
    Browse the repository at this point in the history

  3. updated chunking

    @norlandrhagen
    norlandrhagen committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    eb9bd01 View commit details
    Browse the repository at this point in the history

  4. bump dataflow config, pin gcsfs, only storetozarr

    @norlandrhagen
    norlandrhagen committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    bcf0561 View commit details
    Browse the repository at this point in the history