我有一个运行良好的 Airflow DAG,这些就是任务
T1 = deletes all files from GCS
T2 = Runs SQL query 1 and outputs to a table within BigQuery
T3 = Runs SQL query 2 and outputs to a table within BigQuery
T4 = Runs SQL query 3 and places a copy of this output as csv into the GCS that was emptied in T1
T5= Copies and Appends the reference numbers from the file in T4 to a history table in BigQuery.
现在我正在尝试添加一个检查以查看是否是该月的最后一个星期二;
我尝试过 Bash,但没有成功
这可以使用传感器来实现。传感器将等待事件发生并继续运行下游任务。对于您的用例,最好的选择可能是创建一个用于检查条件的python 传感器。