Alternatives to MLX LM
A Python package and command-line tool for running and fine-tuning language models on Apple silicon. The listings below can replace it for an important use case. Each note says what changes if you switch.
The original
MLX LM
A Python package and command-line tool for running and fine-tuning language models on Apple silicon.
Replacements
Listings that take over the same core job as MLX LM.
llama.cpp
The C++ engine most local AI apps are built on, running language models on ordinary hardware.
llama.cpp is MIT licensed and runs across Windows, macOS, Linux and Android with many GPU backends, but lacks MLX LM's fine-tuning.
Unsloth
A local interface and command-line tool for running and fine-tuning language and diffusion models.
Unsloth runs and fine-tunes models on Windows, macOS and Linux with a local UI and supports MLX and GGUF formats.
Ollama
The simplest way to pull down an open language model and run it on your own machine, from one command or a desktop app.
Ollama is MIT licensed, runs models with one command on all desktop platforms and exposes a local REST API, without fine-tuning.
LM Studio
A polished desktop app for downloading, running and chatting with local language models, with an OpenAI-compatible server built in.
LM Studio wraps MLX and llama.cpp in a closed source desktop GUI with an OpenAI-compatible server and an lms command line tool.
LLM
A command-line tool and Python library for prompting remote and locally installed language models.
LLM is a command-line tool and Python library for prompting remote and local models with SQLite logging, but local models need a plugin.
Also worth comparing
These listings name MLX LM as their own alternative, so the relationship runs both ways.
Axolotl
A command-line tool for fine-tuning language models from YAML configuration files.
MLX LM fine-tunes and quantizes models on Apple silicon Macs instead of Linux GPUs, and its license is not confirmed.
Similar software
Related functionality, not a direct replacement.
LlamaFactory
Web UI and command-line toolkit for fine-tuning over 100 open language and vision-language models.
LLMFarm
An iOS and macOS app for running large language models offline on the device using GGML.
Private LLM
An offline AI chat app for iPhone, iPad and Mac that runs open language models on the device.
