Compare software

KServeLLMKube
Free

Free and open source.

 Free

Free and open source under the Apache 2.0 licence.

Self-hosted Self-hosted, Command line
  • Standard model serving layer on Kubernetes
  • Handles predictive and generative models
  • Mixes NVIDIA, AMD and Apple Silicon nodes in one cluster
  • Pluggable runtimes including vLLM and llama.cpp
  • Requires a Kubernetes cluster and the skills to run one
  • Not suited to single-machine or hobby use
  • Requires a Kubernetes cluster and familiarity with operating one
  • Young project with a small community
Self-hosted Downloadable app, Self-hosted
Open source Open source
License not stated License: Apache-2.0
No account needed No account needed
Not stated if it works offline Not stated if it works offline

Checked September 26, 2026

Checked October 2, 2026

Catalog facts only. Anything “not stated” is unconfirmed. Check full listings for details.