Alternatives to Langfuse
An open-source platform for tracing, evaluating and managing prompts for LLM applications and AI agents. The listings below can replace it for an important use case. Each note says what changes if you switch.
The original
Langfuse
An open-source platform for tracing, evaluating and managing prompts for LLM applications and AI agents.
Replacements
Listings that take over the same core job as Langfuse.
LangSmith
A hosted platform for tracing, monitoring and evaluating LLM applications and AI agents.
LangSmith is a proprietary hosted service with detailed agent tracing, SDKs for four languages and PagerDuty alerts, and self-hosting it requires Kubernetes.
Arize Phoenix
A self-hostable tool for tracing, evaluating and experimenting with LLM applications and agents.
Arize Phoenix offers tracing, evals, prompts and experiments that run locally, in Docker or on Kubernetes, under a source-available rather than open-source license.
Opik
An open-source platform from Comet for debugging, evaluating and monitoring LLM applications and agents.
Opik from Comet is open source with tracing, automated evaluations and dashboards, though self-hosting means running several services and contributors must sign a CLA.
MLflow
An open-source platform for tracing, evaluating and managing LLM applications, agents and machine learning models.
MLflow is Apache-2.0 with OpenTelemetry tracing, 50+ evaluation metrics and prompt optimization, and also covers classic model training.
Helicone
An open-source AI gateway and observability platform for routing, logging and debugging LLM requests.
Helicone works as an Apache-2.0 gateway that logs requests and tracks costs across providers, with less prompt and eval tooling, and its roadmap is uncertain after joining Mintlify.
Weights & Biases
A hosted platform for tracking machine learning experiments, evaluating models and tracing LLM applications.
Weights & Biases is a proprietary hosted platform combining experiment tracking and LLM tracing, with no self-hosted option listed.
Also worth comparing
These listings name Langfuse as their own alternative, so the relationship runs both ways.
DeepEval
An open-source Python framework for unit-testing and evaluating the outputs of large language model applications.
Langfuse pairs evaluations with tracing, prompt management and annotation queues in a hosted or self-hosted platform, requiring you to instrument your application with its SDK.
Evidently
An open-source framework for evaluating, testing and monitoring LLM applications, RAG systems and ML models.
Langfuse centres on tracing, prompt management and evals for LLM apps in a hosted or self-hosted platform, without classic ML drift checks.
Promptfoo
A command-line tool for testing prompts, evaluating model output and red-teaming LLM applications and agents.
Langfuse is an open-source web platform combining tracing, prompt management and evaluation, which requires instrumenting your application with its SDK rather than running tests from a command line.
Similar software
Related functionality, not a direct replacement.
LiteLLM
A self-hosted AI gateway that calls over 100 LLM providers through one OpenAI-compatible API.
Label Studio
An open-source data labeling tool for building training datasets and reviewing AI output.
