Compare software

PromptfooLangSmith
Freemium

The open-source CLI is free; enterprise features are sold separately.

 Freemium

Can be tried for free, with paid plans listed on its pricing page.

Command line Web
  • Runs from the command line with a single npx command
  • Compares prompts and models side by side
  • Detailed step-by-step agent tracing
  • SDKs for Python, TypeScript, Go and Java
  • Red-teaming features are intended for authorized testing of your own applications
  • Some reporting features belong to the paid enterprise edition
  • Proprietary hosted service
  • Self-hosting requires Kubernetes
Downloadable app Self-hosted, Hosted service
Open source Closed source
License not stated License not stated
Not stated if an account is needed Account needed
Not stated if it works offline Needs internet

Checked September 26, 2026

Checked September 26, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.