Compare software

Shimmyllamafile
Free

Free software under Apache-2.0.

 Free

Free and open source under Apache 2.0.

Windows, macOS, Linux, Command line Windows, macOS, Linux, Command line
  • Runs GGUF models behind an OpenAI-compatible API
  • Distributed as a single binary
  • One file holds both the model and the runtime, with nothing to install
  • The same file runs on Windows, macOS, Linux and BSD across several CPU architectures
  • Support is documented for specific model and quantization combinations
  • Single files get large because the model is inside them
  • Versions from 0.10.0 dropped some features that earlier releases had
Downloadable app Downloadable app
Open source Open source
License: Apache-2.0 License: Apache-2.0
Not stated if an account is needed No account needed
Not stated if it works offline Works offline

Checked October 8, 2026

Checked September 21, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.