Skip to content

Commit 306d2d2

Browse files
tatianapankajkoti
authored andcommitted
Add docs related to ExecutionMode.WATCHER and depends_on_past limitation (#2602)
Document the limitation detailed in the ticket #2596 until we implement a solution. (cherry picked from commit ddff652)
1 parent 93b13cc commit 306d2d2

1 file changed

Lines changed: 9 additions & 0 deletions

File tree

docs/guides/run_dbt/airflow-worker/watcher-execution-mode.rst

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -423,6 +423,15 @@ This use case is not currently supported by the ``ExecutionMode.WATCHER``, since
423423

424424
We have a follow-up ticket to `further investigate this use case <https://github.com/astronomer/astronomer-cosmos/issues/2053>`_.
425425

426+
Concurrent DAG runs with ``depends_on_past``
427+
''''''''''''''''''''''''''''''''''''''''''''
428+
429+
When ``depends_on_past=True`` is used together with concurrent DAG runs, a race can occur between consecutive runs where the next run's producer starts while the previous run's consumer fallback is still executing, causing two dbt processes to write to the same models concurrently.
430+
431+
As a workaround, set ``max_active_runs=1`` on the DAG.
432+
433+
For details, see `#2596 <https://github.com/astronomer/astronomer-cosmos/issues/2596>`_.
434+
426435

427436
Advanced config
428437
+++++++++++++++

0 commit comments

Comments
 (0)