Apache NiFi

A visual dataflow system for automating the movement and transformation of data between systems.

FreeOpen sourceWebSelf-hosted
Official websitenifi.apache.orgDownload pagenifi.apache.orgDocumentationnifi.apache.org

These buttons open the developer's own site, repository or store listing in a new tab. wares.gg does not host downloads.

About Apache NiFi

Apache NiFi moves, routes and transforms data between systems. You design, control and monitor flows in a browser-based interface, and can change them while they are running.

It tracks provenance, giving a full lineage of each piece of data, and supports guaranteed delivery, back pressure and dynamic prioritisation. Communication is secured with HTTPS, TLS and SSH, with multi-tenant authorisation. Related projects include MiNiFi and NiFi Registry. It suits teams building data pipelines for observability, security events or AI workloads.

Strengths

  • Browser-based visual flow designer
  • Full data provenance and lineage tracking
  • Flows can be changed at runtime, with back pressure control

Limitations

  • Built for server deployments rather than personal use
  • Takes some effort to learn and operate

Details

Pricing
FreeFree and open source as an Apache Software Foundation project.
License
Apache-2.0
Developer
The Apache Software Foundation
Platforms
Web, Self-hosted
How it runs
Downloadable app, Self-hosted
Account
Not required
Works offline
Yes
Best suited for
Teams building and monitoring data pipelines between systems
Last verified
Added
Provenance
Facts checked against the developer's own pages and store listings, 1 sources on file.

Alternatives to Apache NiFi

Compare all

Software that can replace Apache NiFi for an important use case, and what changes if you switch.

  • Apache Airflow

    A self-hosted platform for writing, scheduling and monitoring workflows defined as Python code.

    FreeOpen sourceWebSelf-hosted

    Apache Airflow defines pipelines as Python code instead of a visual flow designer, and focuses on scheduling and monitoring tasks rather than runtime flow changes.

  • Kestra

    An open-source declarative orchestration platform for scheduled and event-driven workflows, self-hosted or in the cloud.

    FreemiumOpen sourceWebSelf-hosted

    Kestra uses declarative workflows with more than 2,000 plugins and scheduled or event-driven triggers, with a cloud option alongside self-hosting and some enterprise-only features.

  • Dagster

    An open-source orchestrator for building, scheduling and monitoring data pipelines, with a hosted Dagster+ option.

    FreemiumOpen sourceWebSelf-hosted

    Dagster uses an asset-based model with lineage tracking written in code, adds a hosted Dagster+ option, and has an uncertain roadmap after its announced merger with Prefect.

  • Prefect

    A workflow orchestration tool for scheduling, retrying and observing Python data and ML pipelines.

    FreemiumOpen sourceWebSelf-hostedCommand line

    Prefect defines flows with plain Python decorators and adds built-in retries, with some features belonging to its paid hosted platform instead of a visual designer.

  • Node-RED

    Visual flow-based programming tool for wiring together automations and APIs.

    FreeOpen sourceWebSelf-hosted

    Node-RED keeps a visual drag-and-drop flow editor but is aimed at wiring automations and APIs rather than tracking data provenance between systems.

  • Luigi

    A Python tool from Spotify for building, scheduling and visualising pipelines of batch jobs.

    FreeOpen sourceWindowsmacOSLinuxCommand line

    Luigi chains Python batch jobs with automatic dependency resolution and Hadoop support, but has no visual flow designer and is not built for event-driven flows.

Similar software

Related functionality, not necessarily a direct replacement.

Report a wrong fact or a dead link on this listing