Alternatives to LLMFarm
An iOS and macOS app for running large language models offline on the device using GGML. The listings below can replace it for an important use case. Each note says what changes if you switch.
The original
LLMFarm
An iOS and macOS app for running large language models offline on the device using GGML.
Replacements
Listings that take over the same core job as LLMFarm.
Private LLM
An offline AI chat app for iPhone, iPad and Mac that runs open language models on the device.
Private LLM is a paid, closed source app for iPhone, iPad and Mac that adds Siri and Shortcuts integration.
PocketPal AI
A mobile app for Android and iOS that downloads small language models and runs them on the phone.
PocketPal AI runs small models on iOS and Android phones, but has no Mac version listed and is not open source.
Layla
An offline AI assistant app that runs language models directly on Android and iOS devices.
Layla is a freemium, closed source offline assistant for iOS and Android with character creation, without a Mac app.
LM Studio
A polished desktop app for downloading, running and chatting with local language models, with an OpenAI-compatible server built in.
LM Studio covers the Mac side with a polished desktop app using MLX and llama.cpp, but is closed source and has no iOS app.
Similar software
Related functionality, not a direct replacement.
llama.cpp
The C++ engine most local AI apps are built on, running language models on ordinary hardware.
MLX LM
A Python package and command-line tool for running and fine-tuning language models on Apple silicon.
Ollamac
A native macOS app for chatting with language models served by a local Ollama installation.
Ollama
The simplest way to pull down an open language model and run it on your own machine, from one command or a desktop app.