Compare software

vLLMTabbyAPI
Free

Free and open source under the Apache-2.0 license.

 Free

Free and open source.

Linux, Command line Windows, Linux, Self-hosted, Command line
  • High-throughput serving suited to production-scale local deployments
  • Apache-2.0 licensed and actively developed
  • OpenAI-compatible endpoints for existing clients
  • Lightweight server focused on ExLlama models
  • Aimed at developers deploying models rather than casual end users
  • Requires appropriate GPU hardware for good performance
  • Only serves ExLlama-format models
  • No built-in chat interface; pair it with a separate front end
Downloadable app, Self-hosted Downloadable app, Self-hosted
Open source Open source
License: Apache-2.0 License not stated
Not stated if an account is needed No account needed
Not stated if it works offline Works offline

Checked September 22, 2026

Checked September 23, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.