Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

concurrent multipart support for transfer #130

Merged
merged 11 commits into from
Aug 9, 2023
Merged

concurrent multipart support for transfer #130

merged 11 commits into from
Aug 9, 2023

Commits on Jul 25, 2023

  1. concurrent-upload: added API for concurrent uploads in BaseTransfer

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    529fe82 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. concurrent-upload: added S3 implementation of concurrent upload

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    fbbca04 View commit details
    Browse the repository at this point in the history

  2. concurrent-upload: added local implementation of concurrent upload

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    e470b5e View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. concurrent-upload: add progress reporting when uploading chunks

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    6432361 View commit details
    Browse the repository at this point in the history

  2. concurrent-upload: move state at class level to allow using the trans… 

    …fer pool correctly
    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    f7a6ebf View commit details
    Browse the repository at this point in the history

  3. concurrent-upload,local: avoid exposing temporary files to users

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    572691f View commit details
    Browse the repository at this point in the history

  4. concurrent-upload: let user keep track of the upload data and avoid c… 

    …lass state
    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    8fa84e7 View commit details
    Browse the repository at this point in the history

  5. concurrent-upload: use a custom error instead of generic StorageError

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    94c68e8 View commit details
    Browse the repository at this point in the history

  6. util: make ProgressStream seekable 

    botocore wants a seekable stream apparently.
    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    7119c59 View commit details
    Browse the repository at this point in the history

  7. typing: move the methods to a Protocol

    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    70ff235 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2023

  1. concurrent-upload: avoid double upload when not providing progress fu… 

    …nction
    @giacomo-alzetta-aiven
    giacomo-alzetta-aiven committed Aug 8, 2023
    Configuration menu
    Copy the full SHA
    38f2ea1 View commit details
    Browse the repository at this point in the history