Alternatives to LiteLLM
A self-hosted AI gateway that calls over 100 LLM providers through one OpenAI-compatible API. The listings below can replace it for an important use case. Each note says what changes if you switch.
The original
LiteLLM
A self-hosted AI gateway that calls over 100 LLM providers through one OpenAI-compatible API.
Replacements
Listings that take over the same core job as LiteLLM.
OpenRouter
A unified API and chat interface that routes requests to hundreds of AI models across many providers.
OpenRouter is a paid hosted API routing to over 500 models with automatic fallback, so you no longer run a gateway but add a third party in between.
Helicone
An open-source AI gateway and observability platform for routing, logging and debugging LLM requests.
Helicone is an Apache-2.0 AI gateway with stronger request logging and debugging, available hosted or self-hosted, though its roadmap is uncertain after joining Mintlify.
Also worth comparing
These listings name LiteLLM as their own alternative, so the relationship runs both ways.
Pollinations.ai
An open-source platform and API for generating text, images, audio and video with many AI models.
LiteLLM is a self-hosted gateway exposing over 100 providers through one OpenAI-style API, so you run it yourself and supply your own provider access.
Similar software
Related functionality, not a direct replacement.
llama-swap
A proxy server that loads and hot-swaps local AI model servers on demand behind one API.
Bito
A service that routes coding-agent requests to suitable models and adds codebase context to cut costs.
Langfuse
An open-source platform for tracing, evaluating and managing prompts for LLM applications and AI agents.
Ollama
The simplest way to pull down an open language model and run it on your own machine, from one command or a desktop app.
LangSmith
A hosted platform for tracing, monitoring and evaluating LLM applications and AI agents.
