litellm

by BerriAI · MCP Clients & Apps · ★ 61,940

litellm is an app that connects to MCP servers by BerriAI. The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. It has 61,940 GitHub stars and ranks #5 of 595 in MCP Clients & Apps by stars.

Category: MCP Clients & Apps
Author: BerriAI
GitHub stars: 61,940
This week: Tracking since 18 Oct 2026
Language: Python
License: Other
Last update: 2026-10-24 (today)
Links: Source Website PyPI

ai-gateway
anthropic
azure-openai
bedrock
gateway
langchain
litellm
llm
llm-gateway
llmops
mcp-gateway
openai
+4 more

How to install litellm

Install steps differ per project, so follow the README in the litellm repository. Most MCP servers start with a single command (npx -y <package>, uvx <package> or a Docker image) that you add to your client's config. The install guide shows where that goes in Claude Code, Claude Desktop, Cursor and VS Code.

Also listed in

Maintain this project? Get it featured ($99/mo, pinned at the top of MCP Clients & Apps) or see what featuring includes.

Report a problem with this listing

litellm compared

Frequently asked questions

What is litellm?

litellm is an app that connects to MCP servers by BerriAI in the MCP Clients & Apps category. The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. It has 61,940 GitHub stars and ranks #5 of 595 in MCP Clients & Apps by stars.

Is litellm free and open source?

litellm lists its license as Other. Read the license text in the repository before using it in a commercial product, and check whether the service it connects to charges for API access.

What are the alternatives to litellm?

Other MCP Clients & Apps projects on MCP Harbor include n8n, claude-code, gemini-cli. Side-by-side comparisons are linked below, with stars, license, language and last update for each pair. The MCP Clients & Apps category ranks all 595 by stars, and you can re-sort it by growth this week.

Alternatives to litellm

n8nTrending★ 208,446

n8n-io · TypeScript+655 stars this week (+0.3%)

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

claude-code★ 153,207

anthropics · TypeScript

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.

gemini-cli★ 107,576

google-gemini · TypeScript+160 stars this week (+0.1%)

An open-source AI agent that brings the power of Gemini directly into your terminal.

OmniRoute★ 80,504

cheaper-inference · TypeScript

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop

kong★ 44,296

Kong · Lua+19 stars this week (+0%)

🦍 The API and AI Gateway

oh-my-piTrending★ 36,411

can1357 · TypeScript+667 stars this week (+1.9%)

⌥ Coding agent with the IDE wired in. Built by Stencil Labs.

All 595 MCP Clients & Apps MCP servers →

Data last updated 25 October 2026. Stars and downloads are refreshed every day from GitHub and npm.