LiteLLM
A self-hosted AI gateway that calls over 100 LLM providers through one OpenAI-compatible API.
These buttons open the developer's own site, repository or store listing in a new tab. wares.gg does not host downloads.
About LiteLLM
LiteLLM sits between your applications and model providers such as OpenAI, Anthropic, Azure, Bedrock, Vertex AI, vLLM and Nvidia NIM, and exposes them in the OpenAI format or their native format. Applications talk to one endpoint while the gateway handles the provider differences.
The gateway adds cost tracking, guardrails, load balancing and logging. The project has a Rust core and a Python SDK, and it is very actively developed, with tens of thousands of commits on GitHub.
Strengths
- One OpenAI-style API for over 100 providers
- Cost tracking, load balancing and logging built in
- Guardrails for requests and responses
- Very active development
Limitations
- You run and maintain the gateway yourself
- Aimed at developers and teams rather than end users
Details
- Pricing
- FreeFree to download and self-host.
- License
- Open source, license not stated
- Developer
- BerriAI
- Platforms
- Self-hosted
- How it runs
- Self-hosted
- Account
- Not required
- Best suited for
- Teams routing many LLM providers through a single self-hosted endpoint
- Categories
- AI developer tools
- Last verified
- Added
- Sources
Alternatives to LiteLLM
Compare allSoftware that can replace LiteLLM for an important use case, and what changes if you switch.
OpenRouter
A unified API and chat interface that routes requests to hundreds of AI models across many providers.
OpenRouter is a paid hosted API routing to over 500 models with automatic fallback, so you no longer run a gateway but add a third party in between.
Helicone
An open-source AI gateway and observability platform for routing, logging and debugging LLM requests.
Helicone is an Apache-2.0 AI gateway with stronger request logging and debugging, available hosted or self-hosted, though its roadmap is uncertain after joining Mintlify.
LiteLLM as an alternative
Listings that name LiteLLM as an alternative.
Pollinations.ai
An open-source platform and API for generating text, images, audio and video with many AI models.
LiteLLM is a self-hosted gateway exposing over 100 providers through one OpenAI-style API, so you run it yourself and supply your own provider access.
Similar software
Related functionality, not necessarily a direct replacement.
llama-swap
A proxy server that loads and hot-swaps local AI model servers on demand behind one API.
Bito
A service that routes coding-agent requests to suitable models and adds codebase context to cut costs.
Langfuse
An open-source platform for tracing, evaluating and managing prompts for LLM applications and AI agents.
Ollama
The simplest way to pull down an open language model and run it on your own machine, from one command or a desktop app.
LangSmith
A hosted platform for tracing, monitoring and evaluating LLM applications and AI agents.
