You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With HATS, we plan to serialize nested columns as a set of list-columns and include metadata for reconstruction: astronomy-commons/lsdb#466
To support this, we could modify our custom to/read_parquet implementations accordingly. It is not yet clear where HATS will store metadata that maps list-columns back to their respective nested columns. Here, we can explore the possibility of storing this information within the parquet metadata.
Before submitting
Please check the following:
I have described the purpose of the suggested change, specifying what I need the enhancement to accomplish, i.e. what problem it solves.
I have included any relevant links, screenshots, environment information, and data relevant to implementing the requested feature, as well as pseudocode for how I want to access the new functionality.
If I have ideas for how the new feature could be implemented, I have provided explanations and/or pseudocode and/or task lists for the steps.
The text was updated successfully, but these errors were encountered:
Feature request
With HATS, we plan to serialize nested columns as a set of list-columns and include metadata for reconstruction: astronomy-commons/lsdb#466
To support this, we could modify our custom
to/read_parquet
implementations accordingly. It is not yet clear where HATS will store metadata that maps list-columns back to their respective nested columns. Here, we can explore the possibility of storing this information within the parquet metadata.Before submitting
Please check the following:
The text was updated successfully, but these errors were encountered: