Alternatives to Jan
An open-source ChatGPT replacement that runs entirely offline, and can also front cloud providers when you want them. The listings below can replace it for an important use case. Each note says what changes if you switch.
The original
Jan
An open-source ChatGPT replacement that runs entirely offline, and can also front cloud providers when you want them.
Replacements
Listings that take over the same core job as Jan.
LM Studio
A polished desktop app for downloading, running and chatting with local language models, with an OpenAI-compatible server built in.
LM Studio adds in-app Hugging Face model search, MLX support on Apple Silicon and SDKs, but it is closed source, unlike Apache-licensed Jan.
Ollama
The simplest way to pull down an open language model and run it on your own machine, from one command or a desktop app.
Ollama downloads and runs models from one command or a desktop app with a localhost REST API, and focuses on local models rather than fronting many cloud providers.
GPT4All
A local AI chat app with document chat built in, from Nomic AI. Stable, MIT licensed, but not updated since early 2025.
GPT4All is an MIT-licensed local chat app with LocalDocs for offline document questions, runs on CPU, but its latest release dates from February 2025.
AnythingLLM
A desktop AI app that answers questions about your own documents, with no account and no API key needed.
AnythingLLM bundles chat, a vector database and document pipeline in one install, with workspaces for separate document sets, and also works with cloud provider keys.
Msty
Desktop workspace for chatting with local and hosted AI models in one place.
Msty handles local and hosted models with prompt libraries and knowledge bases in one desktop app, but it is closed source with paid workspace features.
TextGen
Chat with local language models using the TextGen desktop interface.
TextGen is an AGPL-3.0 desktop interface for local models with text, vision and API access in portable builds, focused on local rather than cloud providers.
Cherry Studio
Use several AI providers from one desktop chat application.
Cherry Studio is an AGPL-3.0 desktop chat app for several AI providers that supports local model servers, but it does not run models itself like Jan does.
Chatbox
A desktop and mobile chat client for AI models, where you supply your own API keys or point it at a local model.
Chatbox adds Android and iOS builds alongside desktop and supports many providers, but it is only a client and needs Ollama or similar to run local models.
Also worth comparing
These listings name Jan as their own alternative, so the relationship runs both ways.
Alpaca
A GNOME desktop app for managing and chatting with local AI models through Ollama.
Jan runs local models offline and can also front cloud providers, with installers for Windows, macOS and Linux under Apache 2.0, though it is still pre-1.0.
KoboldCpp
A single executable that runs GGUF language models locally, with a web interface and no installation at all.
Jan offers an Apache-licensed offline chat app with installers and cloud provider support, trading KoboldCpp's image and speech features for a simpler chat interface.
llamafile
Packages a language model and the code to run it into one executable file that works on several operating systems without installation.
Jan is an Apache-licensed offline chat app with installers for Windows, macOS and Linux that can also connect to cloud providers, but it requires installation.
Ollamac
A native macOS app for chatting with language models served by a local Ollama installation.
Jan is an Apache-2.0 app for Windows, macOS and Linux that runs models offline itself and can also front cloud providers.
Open WebUI
A self-hosted chat interface that talks to Ollama and any OpenAI-compatible API, so your local models get a proper front end.
Jan is an Apache 2.0 desktop app for Windows, macOS and Linux that runs models offline and fronts cloud APIs, but it is single-user and still pre-1.0.
Page Assist
An open-source browser extension that adds a sidebar and web UI for chatting with local AI models.
Jan is an Apache 2.0 desktop app that runs models itself offline and can front cloud providers, so no separate local model server is needed.
Private LLM
An offline AI chat app for iPhone, iPad and Mac that runs open language models on the device.
Jan is free and open source under Apache 2.0, runs offline on Windows, macOS and Linux, and can also front cloud providers, but has no iOS version.
SillyTavern
A locally-installed front end for language models aimed at long-form roleplay and character-driven writing.
Jan is an Apache 2.0 desktop app with installers that runs models offline and fronts cloud providers, replacing Node or Docker setup but without roleplay-specific tooling.
Witsy
Use AI models and MCP tools through a desktop assistant.
Jan is an Apache 2.0 desktop app that runs models fully offline and fronts cloud providers from one interface, though it is still pre-1.0 and changing fast.
Similar software
Related functionality, not a direct replacement.
llama.cpp
The C++ engine most local AI apps are built on, running language models on ordinary hardware.
