Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update some of the data files in repo from openflights.org #1414

Open
Tracked by #1463 ...
reedy opened this issue Jul 26, 2023 · 4 comments
Open
Tracked by #1463 ...

Update some of the data files in repo from openflights.org #1414

reedy opened this issue Jul 26, 2023 · 4 comments
Labels
export Issues related to data exports (e.g. CSV, JSON, backups). server Things that likely require server access for deployment

Comments

@reedy
Copy link
Collaborator

reedy commented Jul 26, 2023

Trying to test #1398, I noticed BER airport isn't actually in the "default" dataset in the openflights repo.

I know we have data synchronisation issues, but would be nice if we had a way to potentially dump updated airlines, airports and planes tables (at least) to their data/*.dat files to allow to populate "new" dev installs to be somewhere near up to date.

Routes can be done too...

We have import-vrs.py to update the database table for routes.. But no script currently to get it from the table either. And can't populate it locally myself due to #1408

@reedy reedy added server Things that likely require server access for deployment export Issues related to data exports (e.g. CSV, JSON, backups). labels Jul 26, 2023
@reedy reedy changed the title Update some of the data files in openflights repo Update some of the data files in repo from openflights.org Jul 26, 2023
@reedy
Copy link
Collaborator Author

reedy commented Jul 26, 2023

CC @jpatokal

@reedy
Copy link
Collaborator Author

reedy commented Jul 26, 2023

#1417 (comment)

I'm a bit hesitant to make this too easy as long as the website (https://openflights.org/data) makes it seem like the latest data is not meant to be all that easily available:

The GitHub copy is only a sporadically updated static snapshot of the live OpenFlights database (see revision log). If you would like an up-to-the-minute copy, or you would like your data filtered by any information available to us (eg. number of routes at the airport), do not hesitate to contact us.

How sporadic are they supposed to be? :)

I think they're at most ~6 years old, last done in 5d623a6 ?

planes.dat is slightly newer at ~4 years in 4847887

airports.dat last done in 2019 - e3bc6de, which is 3 commits newer than 5d623a6

@jpatokal
Copy link
Owner

jpatokal commented Aug 5, 2023

I'm taking the first week of September off, and plan to spend most of that time doing an update of airlines & airports.

@jpatokal
Copy link
Owner

jpatokal commented Sep 7, 2023

Update to airlines in progress, tracking at #1439 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
export Issues related to data exports (e.g. CSV, JSON, backups). server Things that likely require server access for deployment
Projects
None yet
Development

No branches or pull requests

2 participants