AI developer tools
Tools for developers who build with AI models: model serving, fine-tuning, evaluation and model APIs.
83 results, page 3 of 3
OpenLLM
A command-line tool that serves open-source LLMs as OpenAI-compatible APIs on your own hardware.
OpenVINO Model Server
A self-hosted inference server for serving AI models that have been optimized with OpenVINO.
Opik
An open-source platform from Comet for debugging, evaluating and monitoring LLM applications and agents.
Pipedream
An integration platform giving AI agents and apps managed authentication and prebuilt tools for thousands of APIs.
Pollinations.ai
An open-source platform and API for generating text, images, audio and video with many AI models.
PrivateGPT
A self-hosted API layer for building private AI applications on top of local language models.
Promptfoo
A command-line tool for testing prompts, evaluating model output and red-teaming LLM applications and agents.
Qdrant
An open-source vector search engine written in Rust for similarity search in AI applications.
RAGFlow
An open-source, self-hostable RAG engine with document ingestion, hybrid search and a visual agent builder.
RamaLama
Command-line tool that pulls AI models from any source and serves them locally in containers.
RWKV Runner
A small desktop app that downloads and runs RWKV language models locally with an OpenAI-compatible API.
SGLang
A serving framework for running large language models and multimodal models on your own GPUs.
Sonar
A self-hosted LLM inference server, formerly Aphrodite Engine, that serves Hugging Face models through OpenAI-compatible APIs.
Speaches
A self-hosted, OpenAI API-compatible server for local speech-to-text, translation and text-to-speech models.
Steel
An open-source browser API for running and controlling cloud browser sessions from AI agents.
TabbyAPI
A lightweight, OpenAI-compatible API server for running ExLlama-format language models on your own hardware.
Tavus
An AI video platform for building real-time conversational video agents with lifelike rendered human faces.
TensorBoard
A visualization toolkit for inspecting machine learning training runs, metrics and model graphs.
Unsloth
A local interface and command-line tool for running and fine-tuning language and diffusion models.
Weights & Biases
A hosted platform for tracking machine learning experiments, evaluating models and tracing LLM applications.
Xinference
An open-source inference server for running language, speech and multimodal models through one API.
You.com
A set of web search APIs that return search results, page contents and grounded answers for AI agents.
ZenML
An open-source framework for writing ML pipelines and AI agents in Python and running them on your own infrastructure.
