Compare software

Promptfoo vs MLflow: catalog facts
Promptfoo	MLflow
Freemium The open-source CLI is free; enterprise features are sold separately.	Free Free and open source.
Command line	Web, Self-hosted, Command line
Runs from the command line with a single npx command Compares prompts and models side by side	Tracing built on OpenTelemetry, independent of LLM provider 50+ built-in evaluation metrics and LLM judges
Red-teaming features are intended for authorized testing of your own applications Some reporting features belong to the paid enterprise edition	Broad feature set takes time to learn Running it for a team means hosting and maintaining a server yourself
Downloadable app	Downloadable app, Self-hosted
Open source	Open source
License not stated	License: Apache-2.0
Not stated if an account is needed	No account needed
Not stated if it works offline	Not stated if it works offline
Official website Full listing and sources Checked September 26, 2026	Official website Full listing and sources Checked September 26, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.