Conditional Dataset(Asset) Updates Are Grouped Together Instead of Creating Distinct DAG Runs
Author: jfalltCreated Jul 29, 2025Updated Sep 16, 2026
Labelskind:bugarea:core_eol_affected_version:2.10
Apache Airflow version
Other Airflow 2 version (please specify below)
If "Other Airflow 2 version" selected, which one?
2.10.5
What happened?
I have a DAG with conditional dataset scheduling.
Instead of creating a dag run per dataset update, sometimes airflow will group the events together (if they occur close enough)
What you think should happen instead?
I think there should be a distinct dag run per dataset update
How to reproduce
Create a DAG with conditional scheduling
Create 2 dataset events at the same time that are consumed by the dag we created
Operating System
linux
Versions of Apache Airflow Providers
No response
Deployment
Other Docker-based deployment
Deployment details
No response
Anything else?
Anytime there are dataset updates that happen at the same time or very close together
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Source: apache/airflow