Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

error exporting to parquet file #1042

Open
HuixuanGan opened this issue Jun 21, 2024 · 0 comments
Open

error exporting to parquet file #1042

HuixuanGan opened this issue Jun 21, 2024 · 0 comments

Comments

@HuixuanGan
Copy link

HuixuanGan commented Jun 21, 2024

Code

Code snippet

def export_to_csv(mode, mdf_object, output_csv_path, csv_folder_path):
mdf_object.export(fmt='parquet', filename=output_csv_path, compression='GZIP',reduce_memory_usage = True)

Description

I merged and export a several mf4 files that is about 300MB first then export to the parquet file, but the process always be killed in the middle of execution. Could you tell me how to deal with this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant