Compare software

Sonar vs KTransformers: catalog facts
SonarKTransformers
Free

Free and open source under the AGPL-3.0 licence.

Free

Free to use; published on GitHub.

macOS, Linux, Self-hosted, Command line Linux, Self-hosted
  • OpenAI-compatible API with streaming, embeddings and tool calls
  • Continuous batching and several forms of parallelism for many concurrent users
  • Runs very large models by offloading between CPU and GPU
  • Supports LoRA fine-tuning as well as inference
  • Aimed at server deployments rather than casual desktop chat
  • Recently renamed from Aphrodite Engine, so older guides use the old name
  • Aimed at technical users comfortable with setup and configuration
  • Needs substantial hardware for the largest models
Downloadable app, Self-hosted Self-hosted
Open source Closed source
License: AGPL-3.0 License not stated
No account needed No account needed
Not stated if it works offline Works offline

Checked September 26, 2026

Checked October 2, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.