Compare software

Docker Model RunnerOpenLLM
Free

Part of Docker's tooling; Docker Desktop subscription terms apply to larger organisations.

 Free

Free and open source under the Apache 2.0 licence; BentoCloud hosting is a separate…

Windows, macOS, Linux, Command line Self-hosted, Command line
  • OpenAI-compatible API for local models
  • Fits into existing Docker workflows
  • One command starts an OpenAI-compatible server
  • Wide catalogue of open models, plus custom model repositories
  • Requires Docker to be installed
  • Mainly useful to developers rather than casual users
  • Many models require large GPUs
  • Aimed at developers rather than desktop users
Downloadable app Downloadable app, Self-hosted
Closed source Open source
License not stated License: Apache-2.0
Not stated if an account is needed Not stated if an account is needed
Works offline Not stated if it works offline

Checked October 1, 2026

Checked September 26, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.