Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add parquet output using parquet2 via Rust #1240

Draft
wants to merge 22 commits into
base: main
Choose a base branch
from
Draft

Add parquet output using parquet2 via Rust #1240

wants to merge 22 commits into from

Commits on Dec 15, 2023

  1. Add Rust build support

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    66412ad View commit details
    Browse the repository at this point in the history

  2. rust: add a way to build cxxbridge-cmd

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    9e339b6 View commit details
    Browse the repository at this point in the history

  3. rust: Add a rust_cxx_bridge target.

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    fca8f1a View commit details
    Browse the repository at this point in the history

  4. Initial (rust-only) parquet writer logic

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    ac68f97 View commit details
    Browse the repository at this point in the history

  5. Add support for parquet strings

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    3d9cae5 View commit details
    Browse the repository at this point in the history

  6. Split code into multiple files

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    d554ed7 View commit details
    Browse the repository at this point in the history

  7. Simplify the generic traits by instead enumerating the supported types

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    661438b View commit details
    Browse the repository at this point in the history

  8. Add a table wrapper

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    65536f8 View commit details
    Browse the repository at this point in the history

  9. Table encapsulates writing

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    4eac75e View commit details
    Browse the repository at this point in the history

  10. Add the C++ API for building a table

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    1b55890 View commit details
    Browse the repository at this point in the history

  11. Actually write a parquet file

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    5819f98 View commit details
    Browse the repository at this point in the history

  12. Enable statistics for byte arrays

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    b9c185a View commit details
    Browse the repository at this point in the history

  13. Fix a missing definition level bug

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    9afbf9e View commit details
    Browse the repository at this point in the history

  14. Only flush if something is buffered

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    18d3798 View commit details
    Browse the repository at this point in the history

  15. Document some implementation notes

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    2666346 View commit details
    Browse the repository at this point in the history

  16. Code size tweaks

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    97fbd58 View commit details
    Browse the repository at this point in the history

  17. Clean up and document the API

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    4c2ec63 View commit details
    Browse the repository at this point in the history

  18. Remove the old C-FFI POC code and add an XCTest

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    fdf6b48 View commit details
    Browse the repository at this point in the history

  19. Extremely basic e2e test to prove the file is valid

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    85eb27c View commit details
    Browse the repository at this point in the history

  20. Update guidance about use of the Result type

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    608a650 View commit details
    Browse the repository at this point in the history

  21. Improve the e2e test to validate the file contents

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    0798853 View commit details
    Browse the repository at this point in the history

  22. Document references to docs

    @the80srobot
    the80srobot committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    48ec5ef View commit details
    Browse the repository at this point in the history