Sonar vs Text Embeddings Inference: catalog facts
Sonar | Text Embeddings Inference |
|
Free Free and open source under the AGPL-3.0 licence. |
Free Free and open source under the Apache 2.0 licence. |
|
macOS, Linux, Self-hosted, Command line |
macOS, Linux, Self-hosted |
- OpenAI-compatible API with streaming, embeddings and tool calls
- Continuous batching and several forms of parallelism for many concurrent users
|
- Supports many popular embedding and reranker model families
- Small Docker images with fast startup
|
- Aimed at server deployments rather than casual desktop chat
- Recently renamed from Aphrodite Engine, so older guides use the old name
|
- Serves embedding and classification models only, not text generation
- Set up as a server, so it suits developers rather than casual users
|
|
Downloadable app, Self-hosted |
Downloadable app, Self-hosted |
|
Open source |
Open source |
|
License: AGPL-3.0 |
License: Apache-2.0 |
|
No account needed |
No account needed |
|
Not stated if it works offline |
Works offline |
Checked September 26, 2026 | Checked October 2, 2026 |
Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.
Copy comparison link