Self-Hosted AI Agents
Self-hosted agents ranked by verified user ratings.
Self-hosted AI agents run on your own infrastructure, so data never leaves your network and you control the model, updates, and access. The tradeoff is operational overhead. These agents are ranked by verified user ratings from teams running them in production.
AI agents
baml
The programming language for agents
opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
ai
The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
toon
🎒 Token-Oriented Object Notation (TOON) – Compact, human-readable, schema-aware JSON for LLM prompts. Spec, benchmarks, TypeScript SDK.
DeepSeek-Reasonix
DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.
langchain
The agent engineering platform.
PageIndex
📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
heretic
Fully automatic censorship removal for language models
ponytail
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
Frequently asked questions
What is a self-hosted AI agent?
A self-hosted AI agent runs on infrastructure you control, such as your own cloud account or on-premise servers, rather than the vendor hosting it for you.
Why self-host an AI agent?
Teams self-host mainly for data privacy, compliance, cost control at scale, and the ability to customize or swap models.