Label Studio
An open-source data labeling tool for building training datasets and reviewing AI output.
These buttons open the developer's own site, repository or store listing in a new tab. wares.gg does not host downloads.
About Label Studio
Label Studio is a web interface you run yourself for annotating data of many kinds: images and video, documents and text, audio and speech, time series and multi-modal data. It also covers AI evaluation work, such as reviewing agent traces, collecting human preferences and rankings for RLHF, and scoring LLM output.
It installs with pip or Homebrew, from source, or as a Docker container, then runs at localhost:8080. A commercial edition with more features is offered alongside the open-source version.
Strengths
- Handles images, video, text, audio and time series
- Supports RLHF preference collection and LLM evaluation
- Installs with pip, Homebrew or Docker
Limitations
- Some features are limited to the paid edition
- Needs setup and hosting for team use
Details
- Pricing
- FreemiumThe open-source edition is free; a paid edition adds more features.
- License
- Open source, license not stated
- Developer
- HumanSignal
- Platforms
- Web, Self-hosted
- How it runs
- Self-hosted
- Works offline
- Yes
- Best suited for
- Teams labeling training data or reviewing model output by hand
- Categories
- AI developer tools
- Last verified
- Added
- Sources
Similar software
Related functionality, not necessarily a direct replacement.
Langfuse
An open-source platform for tracing, evaluating and managing prompts for LLM applications and AI agents.
Kiln
A free desktop workbench for building, evaluating and fine-tuning AI systems, with an open-source library.
DeepEval
An open-source Python framework for unit-testing and evaluating the outputs of large language model applications.
Hugging Face Hub
A web platform for hosting, finding and sharing machine learning models, datasets and demo apps.
Promptfoo
A command-line tool for testing prompts, evaluating model output and red-teaming LLM applications and agents.
