Compare software

llamafileKoboldCpp
Free

Free and open source under Apache 2.0.

 Free

Free and open source under the AGPL.

Windows, macOS, Linux, Command line Windows, macOS, Linux
  • One file holds both the model and the runtime, with nothing to install
  • The same file runs on Windows, macOS, Linux and BSD across several CPU architectures
  • A single executable with no installation and no external dependencies
  • Runs on CPU or GPU, with partial offload for machines short on VRAM
  • Single files get large because the model is inside them
  • Versions from 0.10.0 dropped some features that earlier releases had
  • You still have to find and download model files yourself
  • Performance on CPU alone is slow for larger models
Downloadable app Downloadable app
Open source Open source
License: Apache-2.0 License: AGPL-3.0
No account needed No account needed
Works offline Works offline

Checked September 21, 2026

Checked September 21, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.