Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image should clearly communicate run ids #116

Open
lintool opened this issue Jul 9, 2019 · 4 comments
Open

Image should clearly communicate run ids #116

lintool opened this issue Jul 9, 2019 · 4 comments

Comments

@lintool
Copy link
Member

lintool commented Jul 9, 2019

We should standardize a mechanism for each image to clearly communicate the run(s) its produces... at least a human-readable runid.

This issue came up as I was preparing the results table for the overview paper.

@JMMackenzie
Copy link
Member

I would like to add that using the filename of the run is not what one would expect (or I guess, not what I would expect) since the run itself has a specific column for the runid

@lintool
Copy link
Member Author

lintool commented Jul 9, 2019

Sorry! This is a bit of laziness myself as the runs are actually gzipped and I was gathering stats on the web... :)

In my defense, tho, doesn't TREC require that the file name be the same as the runid at submission time?

@JMMackenzie
Copy link
Member

Interesting point, I'm not 100% sure about that but I do recall having some oddly named run files so that might be right! Perhaps we should enforce the same thing?

@lintool
Copy link
Member Author

lintool commented Jul 9, 2019

Agreed!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants