Apache NiFi

Open-source data flow platform for data collection, transfer, transformation and flow orchestration.

Details

Apache NiFi is an open-source data flow processing and automation platform for visually building data collection, transfer, transformation and routing flows. It suits data integration, sensor data, log processing and research data pipelines.

Use cases: data flows, data collection, ETL, data transfer, flow orchestration

Note: NiFi is a data engineering platform; for light personal tasks, start with Python scripts or Prefect.