Compare software

mistral.rsLMDeploy
Free

Free and open source under the MIT licence.

 Free

Free and open source.

Self-hosted, Command line Self-hosted, Command line
  • OpenAI and Anthropic compatible API server
  • Text, image, video and audio input for supported models
  • Combines model compression and serving in one toolkit
  • Built for high-throughput inference
  • Command-line setup aimed at technical users
  • Performance depends on GPU hardware and backend
  • Aimed at developers, not casual users
  • Needs suitable GPU hardware for larger models
Downloadable app, Self-hosted Downloadable app, Self-hosted
Open source Open source
License: MIT License: Apache-2.0
No account needed No account needed
Works offline Works offline

Checked September 26, 2026

Checked October 2, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.