coder_eval

by UiPath · Developer Tools · ★ 154

coder_eval is an MCP server by UiPath. Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates. It has 154 GitHub stars and ranks #448 of 2217 in Developer Tools by stars.

Category: Developer Tools
Author: UiPath
GitHub stars: 154
This week: Tracking since 18 Oct 2026
Language: Python
License: Apache-2.0 (open source)
Last update: 2026-10-23 (yesterday)
Links: Source Website

agent-evaluation
agent-skills
agent-testing
anthropic
claude
claude-code
claude-code-plugins-marketplace
claude-code-skills
claude-skills
codex
coding-agents
evaluation-framework
+8 more

How to install coder_eval

Install steps differ per project, so follow the README in the coder_eval repository. Most MCP servers start with a single command (npx -y <package>, uvx <package> or a Docker image) that you add to your client's config. The install guide shows where that goes in Claude Code, Claude Desktop, Cursor and VS Code.

Also listed in

Maintain this project? Get it featured ($99/mo, pinned at the top of Developer Tools) or see what featuring includes.

Report a problem with this listing

Frequently asked questions

What is coder_eval?

coder_eval is an MCP server by UiPath in the Developer Tools category. Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates. It has 154 GitHub stars and ranks #448 of 2217 in Developer Tools by stars.

Is coder_eval free and open source?

Yes. coder_eval is published under the Apache-2.0 license, so you can run, modify and self-host it at no cost. If it connects to a paid service, that service's own pricing and API terms still apply. Check the repository for the exact license text before using it commercially.

What are the alternatives to coder_eval?

Other Developer Tools projects on MCP Harbor include rea, storybook, context7. Each alternative links to its own page with stars, license and recent activity. The Developer Tools category ranks all 2217 by stars, and you can re-sort it by growth this week.

Alternatives to coder_eval

reaTrending★ 374,738

morluto · TypeScript+72,150 stars this week (+23.8%)

Reverse engineer anything with agents, from app behavior down to native binaries.

storybook★ 91,361

storybookjs · TypeScript

Storybook is the industry standard workshop for building, documenting, and testing UI components in isolation

context7Trending★ 63,566

upstash · TypeScript+372 stars this week (+0.6%)

Context7 Platform -- Up-to-date docs for AI agents

GitNexus★ 48,013

abhigyanpatwari · TypeScript

GitNexus: The Zero-Server Code Intelligence Engine

codebase-memory-mcpTrending★ 47,372

DeusData · C+622 stars this week (+1.3%)

Local code intelligence for developers and AI agents. Connect code, docs and infrastructure in a persistent graph, with CBM Lens, MCP tools, agent integrations and change-aware test selection.

github-mcp-server★ 33,909

github · Go+219 stars this week (+0.7%)

GitHub's official MCP Server

All 2217 Developer Tools MCP servers →

Data last updated 25 October 2026. Stars and downloads are refreshed every day from GitHub and npm.