Open-source workflow scheduling platform for data pipelines, scheduled tasks and research workflow automation.
Apache Airflow is an open-source workflow scheduling and orchestration platform that describes task dependencies as DAGs to run data pipelines, scheduled jobs, batch processes and automated analysis workflows.
Use cases: data engineering, workflow scheduling, scheduled tasks, research workflow automation, ETL
Note: Airflow suits more complex workflows; for small scripted tasks, start with Snakemake, Prefect or the system task scheduler.
