release notes
release notes
Published 2 weeks ago
Contains breaking changesMinimum supported version of Apache Airflow is now 2.11.0. If you want to deploy an old version of Apache Airflow, please use the last released version of the chart 1.19.0.
workers specific sections have been moved to workers.celery / workers.kubernetes sectionsPlease update your configuration accordingly:
workers.command command is now deprecated in favor of workers.celery.command/workers.kubernetes.command (#60067).workers.securityContexts command is now deprecated in favor of workers.celery.securityContexts/workers.kubernetes.securityContexts (#60396).workers.containerLifecycleHooks command is now deprecated in favor of workers.celery.containerLifecycleHooks/workers.kubernetes.containerLifecycleHooks (#61369).workers.kerberosSidecar section is now deprecated in favor of workers.celery.kerberosSidecar/workers.kubernetes.kerberosSidecar (#61881).workers.kerberosInitContainer section is now deprecated in favor of workers.celery.kerberosInitContainer/workers.kubernetes.kerberosInitContainer (#60751).workers.terminationGracePeriodSeconds command is now deprecated in favor of workers.celery.terminationGracePeriodSeconds/workers.kubernetes.terminationGracePeriodSeconds (#61892).workers.nodeSelector command is now deprecated in favor of workers.celery.nodeSelector/workers.kubernetes.nodeSelector (#61957).workers.podDisruptionBudget section is now deprecated in favor of workers.celery.podDisruptionBudget. Please update your configuration accordingly. (#61414)workers.keda section is now deprecated in favor of workers.celery.keda. Please update your configuration accordingly. (#61820)workers.resources section is now deprecated in favor of workers.celery.resources and workers.kubernetes.resources. Please update your configuration accordingly. (#61890)The previous configuration options are still working, but are deprecated and will be removed in a future version.
To enable feature behaviour set dags.gitSync.recommendedProbeSetting to true. Section itself will be removed in future release as to not break setups during upgrades.
As Git-Sync has dedicated liveness service, the liveness probe behaviour will be changed. To enable feature behaviour set dags.gitSync.recommendedProbeSetting to true.
Please update your configuration accordingly.
container_extra_envs and custom_airflow_environment (#60750)The automatic prefix addition for Kubernetes Executor environment variables and secrets has been removed from both the container_extra_envs and custom_airflow_environment helper functions.
What changed:
Previously, when you added environment variables to component-specific configurations (e.g., .Values.scheduler.env), the chart automatically created an additional environment variable (to specified in the env section) with the AIRFLOW__KUBERNETES_ENVIRONMENT_VARIABLES__ prefix for Kubernetes Executor worker pods. After this change, only the variable specified in env section will be created.
Furthermore, for values specified under .Values.secret section, the AIRFLOW__KUBERNETES_SECRETS__ prefix is no longer automatically added. Secrets are now passed as-is via secretKeyRef without the prefixed copy for worker pods.
Why this change:
client_secret information. Previously, due to prefix, it was recognized as internal Airflow configuration leading to unintended exposure in Airflow UI (under Admin -> Configuration), even when AIRFLOW__API__EXPOSE_CONFIG is set to non-sensitive-only.Migration Required:
If you need to pass environment variables specifically to Kubernetes Executor worker pods, use one of the following approaches:
Option 1: Use .Values.env
.. code-block:: yaml
env:
- name: my_var
value: "my_value"
Environment variables specified under .Values.env are now passed as-is without the automatic prefix (same behaviour as component-specific env).
Option 2: Use .Values.config.kubernetes_environment_variables
.. code-block:: yaml
config:
kubernetes_environment_variables:
my_var: "my_value"
3.1.8 (#63392)The default Airflow image that is used with the Chart is now 3.1.8, previously it was 3.1.7.
podAnnotations and airflowPodAnnotations values (#63019)KUBERNETES_ENVIRONMENT_VARIABLES and KUBERNETES_SECRETS prefixes from chart helpers (#60750)workers.celery.nodeSelector & workers.kubernetes.nodeSelector (#61957)workers.celery.terminationGracePeriodSeconds & workers.kubernetes.terminationGracePeriodSeconds (#61892)workers.celery.resources & workers.kubernetes.resources (#61890)workers.celery.keda section (#61820)workers.celery.podDisruptionBudget (#61414)workers.celery.containerLifecycleHooks & workers.kubernetes.containerLifecycleHooks (#61369)livenessProbe & deprecate readinessProbe & add startupProbe (#62334)securityContext values (#62729)apiServer, statsd, and pgbouncer (#62490)securityContexts and containerLifecycleHook (#60677)spec.replicas when HPA is enabled (#63187)workers.celery.kerberosSidecar & workers.kubernetes.kerberosSidecar sections (#61881)tpl rendering for TLS hosts in ingress templates #62358 (#62548)webserver.defaultUser.enabled=false not honored (#62143)*.iml to .gitignore in all distributions (#63636)release notes
Published 2 weeks ago
Contains breaking changesMinimum supported version of Apache Airflow is now 2.11.0. If you want to deploy an old version of Apache Airflow, please use the last released version of the chart 1.19.0.
workers specific sections have been moved to workers.celery / workers.kubernetes sectionsPlease update your configuration accordingly:
workers.command command is now deprecated in favor of workers.celery.command/workers.kubernetes.command (#60067).workers.securityContexts command is now deprecated in favor of workers.celery.securityContexts/workers.kubernetes.securityContexts (#60396).workers.containerLifecycleHooks command is now deprecated in favor of workers.celery.containerLifecycleHooks/workers.kubernetes.containerLifecycleHooks (#61369).workers.kerberosSidecar section is now deprecated in favor of workers.celery.kerberosSidecar/workers.kubernetes.kerberosSidecar (#61881).workers.kerberosInitContainer section is now deprecated in favor of workers.celery.kerberosInitContainer/workers.kubernetes.kerberosInitContainer (#60751).workers.terminationGracePeriodSeconds command is now deprecated in favor of workers.celery.terminationGracePeriodSeconds/workers.kubernetes.terminationGracePeriodSeconds (#61892).workers.nodeSelector command is now deprecated in favor of workers.celery.nodeSelector/workers.kubernetes.nodeSelector (#61957).workers.podDisruptionBudget section is now deprecated in favor of workers.celery.podDisruptionBudget. Please update your configuration accordingly. (#61414)workers.keda section is now deprecated in favor of workers.celery.keda. Please update your configuration accordingly. (#61820)workers.resources section is now deprecated in favor of workers.celery.resources and workers.kubernetes.resources. Please update your configuration accordingly. (#61890)The previous configuration options are still working, but are deprecated and will be removed in a future version.
To enable feature behaviour set dags.gitSync.recommendedProbeSetting to true. Section itself will be removed in future release as to not break setups during upgrades.
As Git-Sync has dedicated liveness service, the liveness probe behaviour will be changed. To enable feature behaviour set dags.gitSync.recommendedProbeSetting to true.
Please update your configuration accordingly.
container_extra_envs and custom_airflow_environment (#60750)The automatic prefix addition for Kubernetes Executor environment variables and secrets has been removed from both the container_extra_envs and custom_airflow_environment helper functions.
What changed:
Previously, when you added environment variables to component-specific configurations (e.g., .Values.scheduler.env), the chart automatically created an additional environment variable (to specified in the env section) with the AIRFLOW__KUBERNETES_ENVIRONMENT_VARIABLES__ prefix for Kubernetes Executor worker pods. After this change, only the variable specified in env section will be created.
Furthermore, for values specified under .Values.secret section, the AIRFLOW__KUBERNETES_SECRETS__ prefix is no longer automatically added. Secrets are now passed as-is via secretKeyRef without the prefixed copy for worker pods.
Why this change:
client_secret information. Previously, due to prefix, it was recognized as internal Airflow configuration leading to unintended exposure in Airflow UI (under Admin -> Configuration), even when AIRFLOW__API__EXPOSE_CONFIG is set to non-sensitive-only.Migration Required:
If you need to pass environment variables specifically to Kubernetes Executor worker pods, use one of the following approaches:
Option 1: Use .Values.env
.. code-block:: yaml
env:
- name: my_var
value: "my_value"
Environment variables specified under .Values.env are now passed as-is without the automatic prefix (same behaviour as component-specific env).
Option 2: Use .Values.config.kubernetes_environment_variables
.. code-block:: yaml
config:
kubernetes_environment_variables:
my_var: "my_value"
3.1.8 (#63392)The default Airflow image that is used with the Chart is now 3.1.8, previously it was 3.1.7.
podAnnotations and airflowPodAnnotations values (#63019)KUBERNETES_ENVIRONMENT_VARIABLES and KUBERNETES_SECRETS prefixes from chart helpers (#60750)workers.celery.nodeSelector & workers.kubernetes.nodeSelector (#61957)workers.celery.terminationGracePeriodSeconds & workers.kubernetes.terminationGracePeriodSeconds (#61892)workers.celery.resources & workers.kubernetes.resources (#61890)workers.celery.keda section (#61820)workers.celery.podDisruptionBudget (#61414)workers.celery.containerLifecycleHooks & workers.kubernetes.containerLifecycleHooks (#61369)livenessProbe & deprecate readinessProbe & add startupProbe (#62334)securityContext values (#62729)apiServer, statsd, and pgbouncer (#62490)securityContexts and containerLifecycleHook (#60677)spec.replicas when HPA is enabled (#63187)workers.celery.kerberosSidecar & workers.kubernetes.kerberosSidecar sections (#61881)tpl rendering for TLS hosts in ingress templates #62358 (#62548)webserver.defaultUser.enabled=false not honored (#62143)*.iml to .gitignore in all distributions (#63636)Apache Airflow - A platform to programmatically author, schedule, and monitor workflows