Skip to content

v1.5.0a8

Pre-release
Pre-release
Compare
Choose a tag to compare

(missing to add all new features that this release includes)

New Features

  • Support for running dbt tasks in AWS EKS in #944 by @VolkerSchiewe
  • Add Clickhouse profile mapping by @roadan and @pankajastro in #353 and #1016
  • Support static_index.html docs by @dwreeves in #999
  • Support deep linking dbt docs via Airflow UI by @dwreeves in #1038
  • (WIP) Support caching dbt ls output in Airflow variable in #1014 by @tatiana
    • since a3: different approach than 1.5.0a1 and 1.5.0a2
    • a4: fix DbtTaskGroup logging
    • a5: introduce CachePurgeConfig
    • a6: purge based on commands passed to dbt ls (only missing: dbt deps)
      remove CachePurgeConfig
      add RenderConfig.airflow_vars_to_purge_cache
    • a7: change from modified timestamp to sha256
    • a8: add 100% test coverage for the caching mechanism
      fix issue with dbt project folder hash not being deterministic per OS/platform
      breakdown improvements in CI in separate PRs
      rename AIRFLOW__COSMOS__EXPERIMENTAL_CACHE to AIRFLOW__COSMOS__ENABLE_CACHE_DBT_LS and switch it on by default
      change cache content to include dag/taskgroup
      introduce method delete_unused_dbt_ls_cache to help cleaning up the cache when DbtDags and DbtTaskGroups are deleted
      pending: documentation and cover delete_unused_dbt_ls_cache with tests

Others