Self-Hosted AI Agents
Self-hosted agents ranked by verified user ratings.
Self-hosted AI agents run on your own infrastructure, so data never leaves your network and you control the model, updates, and access. The tradeoff is operational overhead. These agents are ranked by verified user ratings from teams running them in production.
AI agents
open-webui
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
rtk
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
skyvern
Automate browser based workflows with AI
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
vanna
🤖 Chat with your SQL database 📊. Accurate Text-to-SQL Generation via LLMs using Agentic Retrieval 🔄.
CodeWhale
Open-source, community-driven agent harness
ECC
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
meetily
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows.
CopilotKit
The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Protocol
Frequently asked questions
What is a self-hosted AI agent?
A self-hosted AI agent runs on infrastructure you control, such as your own cloud account or on-premise servers, rather than the vendor hosting it for you.
Why self-host an AI agent?
Teams self-host mainly for data privacy, compliance, cost control at scale, and the ability to customize or swap models.