Compare software

LLMKubeKServe
Free

Free and open source under the Apache 2.0 licence.

 Free

Free and open source.

Self-hosted, Command line Self-hosted
  • Mixes NVIDIA, AMD and Apple Silicon nodes in one cluster
  • Pluggable runtimes including vLLM and llama.cpp
  • Standard model serving layer on Kubernetes
  • Handles predictive and generative models
  • Requires a Kubernetes cluster and familiarity with operating one
  • Young project with a small community
  • Requires a Kubernetes cluster and the skills to run one
  • Not suited to single-machine or hobby use
Downloadable app, Self-hosted Self-hosted
Open source Open source
License: Apache-2.0 License not stated
No account needed No account needed
Not stated if it works offline Not stated if it works offline

Checked October 2, 2026

Checked September 26, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.