mcp-evals

by mclenhard · Developer Tools · ★ 134

mcp-evals is an MCP server by mclenhard. A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working correctly and performing well. It has 134 GitHub stars and ranks #477 of 2217 in Developer Tools by stars.

Category: Developer Tools
Author: mclenhard
GitHub stars: 134
This week: Tracking since 18 Oct 2026
Weekly downloads: 30,535
Language: TypeScript
License: MIT (open source)
Last update: 2025-06-23 (16 months ago)
Links: Source Website npm

ai
evals
mcp

How to install mcp-evals

mcp-evals is published on npm as mcp-evals, and it depends on @modelcontextprotocol/sdk. These steps assume it runs as a local stdio server, which is the usual setup.

Check the README. Confirm the start command and note any API keys or environment variables it needs (pass them with -e KEY=value or an env block). You need Node.js for npx.

Add it to Claude Code from a terminal:

claude mcp add mcp-evals -- npx -y mcp-evals

Or add it to Cursor or Claude Desktop in .cursor/mcp.json or claude_desktop_config.json:

{
  "mcpServers": {
    "mcp-evals": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-evals"
      ]
    }
  }
}

Restart the client and check it. Run claude mcp list, or open the client's MCP settings, and confirm mcp-evals and its tools are listed. The install guide covers VS Code and Codex.

Also listed in

MCP servers for GitHub370

Maintain this project? Get it featured ($99/mo, pinned at the top of Developer Tools) or see what featuring includes.

Report a problem with this listing

Frequently asked questions

What is mcp-evals?

mcp-evals is an MCP server by mclenhard in the Developer Tools category. A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring. This helps ensure your MCP server's tools are working correctly and performing well. It has 134 GitHub stars and ranks #477 of 2217 in Developer Tools by stars.

Is mcp-evals free and open source?

Yes. mcp-evals is published under the MIT license, so you can run, modify and self-host it at no cost. If it connects to a paid service, that service's own pricing and API terms still apply. Check the repository for the exact license text before using it commercially.

What are the alternatives to mcp-evals?

Other Developer Tools projects on MCP Harbor include rea, storybook, context7. Each alternative links to its own page with stars, license and recent activity. The Developer Tools category ranks all 2217 by stars, and you can re-sort it by growth this week.

Alternatives to mcp-evals

reaTrending★ 374,738

morluto · TypeScript+72,150 stars this week (+23.8%)

Reverse engineer anything with agents, from app behavior down to native binaries.

storybook★ 91,361

storybookjs · TypeScript

Storybook is the industry standard workshop for building, documenting, and testing UI components in isolation

context7Trending★ 63,566

upstash · TypeScript+372 stars this week (+0.6%)

Context7 Platform -- Up-to-date docs for AI agents

GitNexus★ 48,013

abhigyanpatwari · TypeScript

GitNexus: The Zero-Server Code Intelligence Engine

codebase-memory-mcpTrending★ 47,372

DeusData · C+622 stars this week (+1.3%)

Local code intelligence for developers and AI agents. Connect code, docs and infrastructure in a persistent graph, with CBM Lens, MCP tools, agent integrations and change-aware test selection.

github-mcp-server★ 33,909

github · Go+219 stars this week (+0.7%)

GitHub's official MCP Server

All 2217 Developer Tools MCP servers →

Data last updated 25 October 2026. Stars and downloads are refreshed every day from GitHub and npm.