New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Without providing metadata cannot round-trip struct columns via interop/from/to_arrow #17061

Open

wence- opened this issue Oct 11, 2024 · 0 comments

Labels

Contributor

wence- commented Oct 11, 2024

Describe the bug

import pyarrow as pa
import pylibcudf as plc

host_c = pa.array([{"a": [1, 2], "b": [3, 4]}])
device_c = plc.interop.from_arrow(host_c)
on_host = plc.interop.to_arrow(device_c)

# > RuntimeError: CUDF failure at: /home/coder/cudf/cpp/src/interop/to_arrow_schema.cpp:146: Number of field names and number of children doesn't match

We either need to construct appropriate (empty) metadata for child columns, or handle it in to_arrow_schema on the C++ side.

wence- added bug pylibcudf labels

madsbk added a commit to madsbk/cudf that referenced this issue


          xfail rapidsai#17061

6bc388c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment