Replies: 1 comment 3 replies
-
Hi @selipot, this summer I've looked into Parquet as a file-format for parcels: #1399, see also this discussion. But some people (e.g. @oj-tooth, who develops https://github.com/oj-tooth/lt_toolbox) convert the Parcels zarr-output to parquet before post-processing, after which it can be much faster to work with the data. So it depends what you want: most parcels users will be used to zarr-output, so if you want a user-friendly (but slightly larger) output I'd go for the regular 2D arrays. Otherwise, ragged arrays or parquet file will be more efficient |
Beta Was this translation helpful? Give feedback.
-
I am working towards releasing on AWS a dataset of numerical particles released with Parcels in a global HYCOM simulation. However, my particles can become grounded (or beached) and I am devising a method to flag when this happens. I am debating how to publish the data, as regular 2D arrays with dimensions
(trajectory,obs)
with an additional flag array to indicate beaching, or as ragged arrays following the clouddrift model? The latest data structure is the basis of the analysis tools of the clouddrift library.1 vote ·
Beta Was this translation helpful? Give feedback.
All reactions