Compare software

Rapid-MLXLlama
Free

Free and open source under the Apache License 2.0.

 Free

Free to download via Homebrew or GitHub releases.

macOS, Self-hosted macOS
  • Runs inference locally on Apple Silicon
  • Provides OpenAI and Anthropic compatible API endpoints
  • Built on llama.cpp by its own maintainers
  • Runs a local API server for other apps
  • Requires Apple Silicon
  • macOS only
  • Lives in the menu bar rather than offering a full chat workspace
Downloadable app, Self-hosted Downloadable app
Open source Closed source
License: Apache-2.0 License not stated
Not stated if an account is needed No account needed
Not stated if it works offline Works offline

Checked October 8, 2026

Checked October 1, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.