Self-Hosted AI Agents
Self-hosted agents ranked by verified user ratings.
Self-hosted AI agents run on your own infrastructure, so data never leaves your network and you control the model, updates, and access. The tradeoff is operational overhead. These agents are ranked by verified user ratings from teams running them in production.
AI agents
langfuse
🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
llama_index
LlamaIndex is the leading document agent and OCR platform
agenticSeek
Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity. 🔔 Official updates only via twitter @Martin993886460 (Beware of fake account)
LightRAG
[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation"
agentscope
Build and run agents you can see, understand and trust.
promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
dify
Production-ready platform for agentic workflow development.
MetaGPT
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
FastGPT
FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.
mlc-llm
Universal LLM Deployment Engine with ML Compilation
jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
CowAgent
Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, self-evolves with memory and knowledge. Multi-model, multi-channel. Lightweight, extensible, one-line install. (formerly chatgpt-on-wechat)
Frequently asked questions
What is a self-hosted AI agent?
A self-hosted AI agent runs on infrastructure you control, such as your own cloud account or on-premise servers, rather than the vendor hosting it for you.
Why self-host an AI agent?
Teams self-host mainly for data privacy, compliance, cost control at scale, and the ability to customize or swap models.