Apache Airflow
Apache Airflow is a programmatic orchestration platform that allows you to manage workflows by defining them as code. The planner (schedular) runs tasks in a worker's pool within the framework of the defined dependencies. With the user interface, you can easily visualize pipelines and perform operations on DAG with command line tools.
apache · Analytics & Business Intelligence
Common commercial products in this category: Tableau, Power BI, Looker
- You orchestrate tasks with workflows (DAG) that you define as code.
- You visualize data pipelines and workflows through the rich user interface.
- You manage complex DAG operations using command line tools.
- • High number of open issues (1,960)
- ↑ PositiveHacker News
Introduction to Apache Airflow
“Thread a few weeks back with Apache Airflow's cousin Apache Nifi [0] . A lot of great discussion in that thread, just like in this one. [0]”
- • NeutralHacker News
Lessons learned from running Apache Airflow at scale
“Apache Airflow is tool for *analytical data* pipelines. If you want to create a daily/monthly data feed from your operational DB, move to it into Data warehouse, run jobs to process/aggregate that data and create daily/weekly/monthly reports, Airflow may help with all those.”
Verified against README · Oct 26, 2026 · source
My note
Alternative pages
More in: Analytics & Business Intelligence
- Apache Superset★ 75,375 · today
- streamlit★ 46,175 · today
- Polars★ 40,237 · today
- awesome-datascience★ 30,251 · 3 days ago
- Redash★ 28,853 · yesterday
- Cube★ 21,138 · today