Self-Hosted AI Agents
Self-hosted agents ranked by verified user ratings.
Self-hosted AI agents run on your own infrastructure, so data never leaves your network and you control the model, updates, and access. The tradeoff is operational overhead. These agents are ranked by verified user ratings from teams running them in production.
AI agents
axolotl
Go ahead and axolotl questions
oh-my-pi
⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more
omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
evidently
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
unstract
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
LLM-Agent-Paper-List
The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.
TaxHacker
Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories
code2prompt
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
suna
The Company AI Command Center
LangBot
Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow
llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Frequently asked questions
What is a self-hosted AI agent?
A self-hosted AI agent runs on infrastructure you control, such as your own cloud account or on-premise servers, rather than the vendor hosting it for you.
Why self-host an AI agent?
Teams self-host mainly for data privacy, compliance, cost control at scale, and the ability to customize or swap models.