HNHacker News
TopNewBestAskShowJobs

seeyam

18 karma · joined July 29, 2024

submissionscomments
seeyam··on Understanding Airflow DAG and Task Concurrency on Google Cloud Composer
At scale it's probably to ensure your environment is capable of handling as many DAGs as possible. also as a data engineer, not knowing why a task isn't running can be frustrating. so this might help those understand and resolve