Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Airflow #62

Open
AntoineAugusti opened this issue Aug 23, 2018 · 0 comments
Open

Airflow #62

AntoineAugusti opened this issue Aug 23, 2018 · 0 comments
Labels
ops

Comments

@AntoineAugusti
Copy link
Member

  • install Embulk (embulk gem install embulk-output-postgresql and embulk gem install embulk-input-oracle)
  • symlink opendata/transformers folder to airflow/dags/transformers
  • symlink opendata/sql folder airflow/opendata_sql
  • symlink opendata/config folder airflow/dags/config
  • set env variable SECMAR_OPENDATA_HASH_SECRET in systemd process
  • Add connections
  • Add variables
  • update work_mem to 50MB in postgresql.conf
  • install Git LFS
  • disable lock verify for LFS git config 'lfs.http://git-server.com/user/test.locksverify' false
@AntoineAugusti AntoineAugusti self-assigned this Aug 23, 2018
@AntoineAugusti AntoineAugusti removed their assignment Aug 22, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
ops
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AntoineAugusti