Prefect

Open-source data workflow tool for Python data pipelines, task scheduling and automated analysis.

Details

Prefect is an open-source Python workflow orchestration tool for building, running and monitoring data pipelines and automated tasks. It suits Python data analysis, research batch processing, scheduled tasks and lightweight data engineering workflows.

Use cases: Python workflows, data pipelines, automated analysis, task scheduling, research batch processing

Note: For complex enterprise-level scheduling, compare it with Airflow.