Compare software

mistral.rsKTransformers
Free

Free and open source under the MIT licence.

 Free

Free to use; published on GitHub.

Self-hosted, Command line Linux, Self-hosted
  • OpenAI and Anthropic compatible API server
  • Text, image, video and audio input for supported models
  • Runs very large models by offloading between CPU and GPU
  • Supports LoRA fine-tuning as well as inference
  • Command-line setup aimed at technical users
  • Performance depends on GPU hardware and backend
  • Aimed at technical users comfortable with setup and configuration
  • Needs substantial hardware for the largest models
Downloadable app, Self-hosted Self-hosted
Open source Closed source
License: MIT License not stated
No account needed No account needed
Works offline Works offline

Checked September 26, 2026

Checked October 2, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.