Alternatives to LlamaFactory
Web UI and command-line toolkit for fine-tuning over 100 open language and vision-language models. The listings below can replace it for an important use case. Each note says what changes if you switch.
The original
LlamaFactory
Web UI and command-line toolkit for fine-tuning over 100 open language and vision-language models.
Replacements
Listings that take over the same core job as LlamaFactory.
Unsloth
A local interface and command-line tool for running and fine-tuning language and diffusion models.
Unsloth also runs and fine-tunes models locally with a UI and CLI, adds diffusion models and GGUF or MLX formats, and has macOS support, but its license is not stated.
Axolotl
A command-line tool for fine-tuning language models from YAML configuration files.
Axolotl defines fine-tuning runs in YAML configuration files from the command line, with Docker images and DeepSpeed configs, but has no web interface and targets Linux.
MLX LM
A Python package and command-line tool for running and fine-tuning language models on Apple silicon.
MLX LM fine-tunes and quantizes models on Apple silicon Macs from Python or the terminal, dropping the web UI and Windows or Linux support, with an unconfirmed license.
Similar software
Related functionality, not a direct replacement.
Kohya's GUI
A local graphical interface for training LoRA models and fine-tuning Stable Diffusion image models.
vLLM
High-throughput, memory-efficient inference and serving engine for LLMs.
nvitop
Interactive terminal viewer for NVIDIA GPUs and the processes running on them.
Ollama
The simplest way to pull down an open language model and run it on your own machine, from one command or a desktop app.
llama.cpp
The C++ engine most local AI apps are built on, running language models on ordinary hardware.
SGLang
A serving framework for running large language models and multimodal models on your own GPUs.
