Compare software

MLflow vs LangSmith: catalog facts
MLflowLangSmith
Free

Free and open source.

Freemium

Can be tried for free, with paid plans listed on its pricing page.

Web, Self-hosted, Command line Web
  • Tracing built on OpenTelemetry, independent of LLM provider
  • 50+ built-in evaluation metrics and LLM judges
  • Detailed step-by-step agent tracing
  • SDKs for Python, TypeScript, Go and Java
  • Broad feature set takes time to learn
  • Running it for a team means hosting and maintaining a server yourself
  • Proprietary hosted service
  • Self-hosting requires Kubernetes
Downloadable app, Self-hosted Self-hosted, Hosted service
Open source Closed source
License: Apache-2.0 License not stated
No account needed Account needed
Not stated if it works offline Needs internet

Checked September 26, 2026

Checked September 26, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.