self-hosted-ai-stack

by hwdsl2 · Cloud & Infra · ★ 170

self-hosted-ai-stack is an MCP server by hwdsl2. Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. It has 170 GitHub stars and ranks #193 of 1058 in Cloud & Infra by stars.

Category: Cloud & Infra
Author: hwdsl2
GitHub stars: 170
This week: Tracking since 18 Oct 2026
Language: Shell
License: MIT (open source)
Last update: 2026-10-24 (today)
Links: Source Website

ai
ai-stack
cuda
docker
docker-compose
docling
embeddings
linux
litellm
llm
local-ai
mcp
+8 more

How to install self-hosted-ai-stack

Install steps differ per project, so follow the README in the self-hosted-ai-stack repository. Most MCP servers start with a single command (npx -y <package>, uvx <package> or a Docker image) that you add to your client's config. The install guide shows where that goes in Claude Code, Claude Desktop, Cursor and VS Code.

Also listed in

Maintain this project? Get it featured ($99/mo, pinned at the top of Cloud & Infra) or see what featuring includes.

Report a problem with this listing

Frequently asked questions

What is self-hosted-ai-stack?

self-hosted-ai-stack is an MCP server by hwdsl2 in the Cloud & Infra category. Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-first with auto-configured authentication, lightweight stacks, optional HTTPS and NVIDIA GPU support. It has 170 GitHub stars and ranks #193 of 1058 in Cloud & Infra by stars.

Is self-hosted-ai-stack free and open source?

Yes. self-hosted-ai-stack is published under the MIT license, so you can run, modify and self-host it at no cost. If it connects to a paid service, that service's own pricing and API terms still apply. Check the repository for the exact license text before using it commercially.

What are the alternatives to self-hosted-ai-stack?

Other Cloud & Infra projects on MCP Harbor include RuView, worldmonitor, netdata. Each alternative links to its own page with stars, license and recent activity. The Cloud & Infra category ranks all 1058 by stars, and you can re-sort it by growth this week.

Alternatives to self-hosted-ai-stack

RuView★ 99,349

ruvnet · Rust

π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.

worldmonitorTrending★ 89,385

koala73 · TypeScript+778 stars this week (+0.9%)

Real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface

netdata★ 81,113

netdata · Go+128 stars this week (+0.2%)

The fastest path to AI-powered full stack observability, even for lean teams.

LibreChatTrending★ 46,238

LibreChat-AI · TypeScript+377 stars this week (+0.8%)

Enhanced ChatGPT Clone: Features Agents, MCP, Skills, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User A

nacos★ 33,474

alibaba · Java+14 stars this week (+0%)

an easy-to-use dynamic service discovery, configuration and service management platform for building AI cloud native applications.

dapr★ 26,154

dapr · Go+3 stars this week (+0%)

Dapr is a portable runtime for building distributed applications across cloud and edge, combining event-driven architecture with workflow orchestration.

All 1058 Cloud & Infra MCP servers →

Data last updated 25 October 2026. Stars and downloads are refreshed every day from GitHub and npm.