Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CSV output format #71

Open
YATV opened this issue Jul 21, 2022 · 2 comments
Open

CSV output format #71

YATV opened this issue Jul 21, 2022 · 2 comments

Comments

@YATV
Copy link

YATV commented Jul 21, 2022

Hello!
If you save it to a file in the JSON format, then a lot of traffic is generated and it takes up a lot of space (even with compression). It would be very nice to be able to save to a file in CSV format
Thank you!

@Lukas955
Copy link
Collaborator

Hi,

to be honest, I don't think any text file format is suitable for storing big data.

The disadvantage of CSV formatting is that you need to directly specify the fields that should appear in each column. In other words, you need to know exactly what is in the data of the exporter and what you want to store. In contrast, the good thing about JSON is that it is a very flexible format that allows you to easily convert very flexible IPFIX records.

We currently have no plans to add support for formatting to a CSV file in the near future.

Lukas

@sedmicha
Copy link
Collaborator

What you can currently do is store the data in the Nffile format and then use a tool like Nfdump to read the data as CSV. There's a problem that Nfdump doesn't fully support all that IPFIX has to offer, but if you don't use any special fields it might be a suitable solution for you.

There's also the FDS format designed to be even more efficient, but the equivalent Fdsdump tool is still in development. Once that's done, that would probably be the better choice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants