Alternatives to LLMFarm

An iOS and macOS app for running large language models offline on the device using GGML. The listings below can replace it for an important use case. Each note says what changes if you switch.

The original

Replacements

Listings that take over the same core job as LLMFarm.

  • Private LLM

    An offline AI chat app for iPhone, iPad and Mac that runs open language models on the device.

    PaidProprietarymacOSiOS

    Private LLM is a paid, closed source app for iPhone, iPad and Mac that adds Siri and Shortcuts integration.

  • PocketPal AI

    A mobile app for Android and iOS that downloads small language models and runs them on the phone.

    FreeProprietaryAndroidiOS

    PocketPal AI runs small models on iOS and Android phones, but has no Mac version listed and is not open source.

  • Layla

    An offline AI assistant app that runs language models directly on Android and iOS devices.

    Layla is a freemium, closed source offline assistant for iOS and Android with character creation, without a Mac app.

  • LM Studio

    A polished desktop app for downloading, running and chatting with local language models, with an OpenAI-compatible server built in.

    LM Studio covers the Mac side with a polished desktop app using MLX and llama.cpp, but is closed source and has no iOS app.

Similar software

Related functionality, not a direct replacement.