Compare software

Sonar vs LMDeploy: catalog facts
Sonar	LMDeploy
Free Free and open source under the AGPL-3.0 licence.	Free Free and open source.
macOS, Linux, Self-hosted, Command line	Self-hosted, Command line
OpenAI-compatible API with streaming, embeddings and tool calls Continuous batching and several forms of parallelism for many concurrent users	Combines model compression and serving in one toolkit Built for high-throughput inference
Aimed at server deployments rather than casual desktop chat Recently renamed from Aphrodite Engine, so older guides use the old name	Aimed at developers, not casual users Needs suitable GPU hardware for larger models
Downloadable app, Self-hosted	Downloadable app, Self-hosted
Open source	Open source
License: AGPL-3.0	License: Apache-2.0
No account needed	No account needed
Not stated if it works offline	Works offline
Official website Full listing and sources Checked September 26, 2026	Official website Full listing and sources Checked October 2, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.