MCP servers for web scraping 412
These MCP servers and clients focus on web scraping, matched from their name, description and GitHub topics. MCP Harbor lists 412 of them; the most starred are browser-use (★119,003), Agent-Reach (★101,437) and Scrapling (★89,376).
91% open source · mostly JavaScript, Python, TypeScript · 276 updated in the last 30 days · fastest this week: Agent-Reach (+2,844 stars)
No servers on this page match that filter. Try one word, such as a product name, or .
browser-use · Python+699 stars this week (+0.6%)
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
Panniantong · Python+2,844 stars this week (+2.9%)
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
D4Vinci · Python+1,131 stars this week (+1.3%)
🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
gpt-researcher★ 30,272
assafelovic · Python+133 stars this week (+0.4%)
An autonomous agent that conducts deep research on any data using any LLM providers
Douyin_TikTok_Download_API★ 20,863
Evil0ctal · Python+127 stars this week (+0.6%)
🚀 自托管的抖音、TikTok、B 站数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok, Douyin & Bilibili scraper and no-watermark video downloader — async REST API, MCP server for AI agents, CLI and web console, plus offline speech-to-text for downloaded videos. Self-healing identity p
Skill_Seekers★ 15,207
yusufkaraaslan · Python+39 stars this week (+0.3%)
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
apify · TypeScript+1,179 stars this week (+10.1%)
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
camofox-browser★ 11,883
jo-inc · JavaScript
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
mobile-mcp★ 9,941
mobile-next · TypeScript+246 stars this week (+2.5%)
Model Context Protocol Server for Mobile Automation and Scraping (iOS, Android, Emulators, Simulators and Real Devices)
firecrawl-mcp-server★ 7,675
firecrawl · JavaScript+52 stars this week (+0.7%)
Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.
wigolo★ 5,501
KnockOutEZ · TypeScript+20 stars this week (+0.4%)
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
exa-mcp-server★ 5,163
exa-labs · TypeScript+23 stars this week (+0.4%)
Exa MCP for web search and web crawling!
JobSpy★ 4,549
speedyapply · Python
Jobs scraper library for LinkedIn, Indeed, Glassdoor, ZipRecruiter, Bayt, Naukri, BDJobs & HelloWork
design-extract★ 4,345
Manavarya09 · HTML+95 stars this week (+2.2%)
Extract any website's complete design system with one command. DTCG tokens, semantic+primitive+composite, MCP server for Claude Code/Cursor/Windsurf, multi-platform emitters (iOS SwiftUI, Android Compose, Flutter, WordPress), Tailwind v4, Figma variables, shadcn/ui, CSS health audit, WCAG remediatio
linkedin-mcp-server★ 4,004
stickerdaniel · Python+98 stars this week (+2.5%)
Open-source MCP server for LinkedIn. Give Claude and any MCP-compatible AI agent access to profiles, companies, jobs, and messages.
vibheksoni · Python+907 stars this week (+38.4%)
Stealth browser automation for AI agents over MCP and the Chrome DevTools Protocol: navigation, network hooks, DOM extraction, and pixel-accurate UI cloning.
brightdata-mcp★ 2,686
brightdata · JavaScript+7 stars this week (+0.3%)
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
tavily-mcp★ 2,454
tavily-ai · TypeScript
Production ready MCP server with real-time search, extract, map & crawl.
webclaw★ 2,388
0xMassi · Rust+7 stars this week (+0.3%)
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
mcp-crawl4ai-rag★ 2,269
coleam00 · Python
Web Crawling and RAG Capabilities for AI Agents and AI Coding Assistants
DevDocs★ 2,107
cyberagiinc · TypeScript
Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App
crw★ 1,173
fastcrw · Rust+28 stars this week (+2.4%)
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use ma
x-reader★ 970
runesleo · Python+2 stars this week (+0.2%)
Universal content reader MCP Server for 10+ platforms
donsetch★ 938
dondai44423 · Rust
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
feder-cr · Python
Playwright MCP server undetected by anti-bots and captchas: AI agent browses the web on anti-detect stealth Firefox, Python, undetected browser automation, scraping, computer use.
quantumproxies.io★ 874
quantumproxies · Java
Residential, datacenter, ISP & mobile proxies with 90M+ IPs in 200+ countries — plus Scraper & SERP APIs. Code examples in Python, Node.js, PHP, Go, Java, C#, Ruby and curl.
crawlseo★ 647
crawlseo · TypeScript
Open-source SEO monitoring. GSC + Site Crawler + Core Web Vitals in one dashboard.
semrush-ai-tool★ 636
springvoiceswell · JavaScript
Semrush SEO AI-powered analysis tool MCP server & CLI for keyword research, domain analytics, backlink analysis
XActions★ 617
nirholas · HTML+18 stars this week (+3%)
⚡ The Complete X/Twitter Automation Toolkit — Scrapers, MCP server for AI agents (Claude/GPT), CLI, browser scripts. No API fees. Open source. Unfollow people who don't follow back. Monitor real-time analytics. Auto follow, like, comment, scrape, without API. Follow Bot. Like bot. Grow your account
seo★ 592
iannuttall · TypeScript
SEO for agent-native teams. Your agent gets your real Search Console, Google Analytics, Bing and crawl data through an MCP server and CLI, so it stops guessing.
n8n-claw★ 560
freddy-schuetz · Shell
OpenClaw-inspired autonomous AI agent built entirely in n8n. Adaptive RAG-powered memory, Skills via MCP templates, Expert Agents with delegated sub-agents, proactive task management, media understanding - self-hosted with one setup script
pullmd★ 491
AeternaLabsHQ · JavaScript
Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.
doctor★ 458
sisig-ai · Python
Doctor is a tool for discovering, crawl, and indexing web sites to be exposed as an MCP server for LLM agents.
camofox-browser★ 428
redf0x1 · JavaScript
Anti-detection browser server for AI agents — REST API wrapping Camoufox engine with OpenClaw plugin support
graphlit-mcp-server★ 377
graphlit · TypeScript
Model Context Protocol (MCP) Server for Graphlit Platform
mcp-omnisearch★ 357
spences10 · TypeScript+1 stars this week (+0.3%)
🔍 A Model Context Protocol (MCP) server providing unified access to multiple search engines (Tavily, Brave, Kagi, Exa), AI tools (Kagi FastGPT, Exa, Linkup), and content extraction services (Firecrawl, Tavily, Kagi). Includes GitHub search. All through a single interface.
SpotifyScraper★ 322
AliAkhtari78 · Python+1 stars this week (+0.3%)
Extract public Spotify data — tracks, albums, artists, playlists, podcasts & lyrics — without the official API. Sync + async, typed models, one dependency.
RamsesAguirre777 · Python
Free, self-hosted MCP server that scrapes the public Facebook Ad Library (no API token) for competitive ad research — advertiser, copy, landing pages, CTAs, any country.
PyScrappy★ 263
mldsveda · Python
Adaptive Python web scraping toolkit + MCP server for AI agents. Self-healing selectors that survive site changes, TLS-fingerprint stealth to bypass anti-bot filters, CSS/XPath parsing, and 24 built-in scrapers, clean, structured, LLM-ready data from any URL.
Uni-CLI★ 232
olo-dot-io · TypeScript
One command for every interface—search, run, and inspect real software across APIs, browsers, desktops, local tools, and MCP.
amazon-scraper-v2★ 223
apiguru-app · Python
Agent-ready Amazon Scraper API: real-time product details (batch ASIN), offers & stock, reviews, search, best sellers, deals and seller data across 20 marketplaces. One pasted line for Claude Code / Codex / Cursor, an MCP server, or plain HTTP with 3 free calls a day and no key. Python examples insi
clearcote-browser★ 221
clearcotelabs · Python
Open-source stealth Chromium with engine-level fingerprint spoofing - de-Googled, drop-in Playwright, fully buildable and verifiable from source.
x-twitter-scraper★ 220
Xquik-dev · JavaScript
X (Twitter) scraper API & Twitter MCP server to scrape tweets, profiles & followers. Not affiliated with X Corp.
linkedin-mcp-server★ 201
eliasbiondo · Python
🔗 A Model Context Protocol (MCP) server for LinkedIn — search people, companies, and jobs, scrape profiles, and get structured data via any MCP-compatible AI client.
charlotte★ 183
TickTockBent · TypeScript
Token-efficient browser MCP server — structured web pages for AI agents, not raw accessibility dumps
agentql-mcp★ 181
tinyfish-io · TypeScript
Model Context Protocol server that integrates AgentQL's data extraction capabilities.
searxNcrawl★ 181
DasDigitaleMomentum · Python
Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole sites and logged-in areas. Self-hosted, no API key. Firecrawl-compatible API planned.
search1api-mcp★ 173
superagents-lab · TypeScript
Official Search1API MCP server for web search, news, crawling, sitemaps, and trends—hosted with OAuth 2.1 or local via npm.
indonesia-gov-apis★ 173
suryast · Python
🇮🇩 50+ Indonesian Government APIs & Data Sources — BPS, OJK, BPJPH, BPOM, Bank Indonesia, IDX, BMKG + MCP servers. Python examples, scraping patterns, and practical gotchas. It's very challenging to keep up with all the breaking and blocking changes of Indonesian government APIs and digital resour
just-every · TypeScript
Quickly reads webpages and converts to markdown for fast, token efficient web scraping
servo-fetch★ 162
konippi · Rust
A self-contained browser engine that fetches, renders, and extracts web content as Markdown, JSON, or screenshots — no Chromium, no API key, no setup.
MySearch-Proxy★ 161
skernelx · Python
Unified search MCP, proxy console, and skill for Tavily, Firecrawl, and Social / X.
reddit-mcp-server★ 160
eliasbiondo · Python
🔗 A zero-config Model Context Protocol (MCP) server for Reddit — search posts, browse subreddits, scrape user activity, and get structured data via any MCP-compatible AI client. No API keys or authentication needed.
foxprofile★ 153
chienbm98 · Python
Free, open-source anti-detect browser profile manager: per-profile fingerprint, cookies and proxy, Camoufox and Chrome engines, desktop app, REST API and MCP server for AI agents. Self-hosted alternative to GoLogin / MoreLogin.
WebReaper★ 152
alex-on-ai · C#
AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.
mtwn105 · TypeScript
Turn topics, links, and files into AI-generated research notebooks — summarize, explore, and ask anything.
one-search-mcp★ 147
yokingma · TypeScript
🚀 OneSearch MCP Server: Web Search & Scraper & Extract, Support agent-browser, SearXNG, Tavily, DuckDuckGo, Bing, etc.
web-scout-mcp★ 137
pinkpixel-dev · JavaScript
An MCP server providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content.
henrique-coder · Python
An advanced, high-performance Python client, MCP server, and REST API for reverse-engineering Perplexity AI's WebUI.
apitap★ 130
n1byn1kt · TypeScript
CLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.
qz-browser-agent★ 125
alibaba · JavaScript
Local-first AI agent for Chrome: browser automation, web research, and data extraction with your own model.
scrapling-fetch-mcp★ 125
cyberchitta · Python
Helps AI assistants access text content from bot-protected websites. MCP server that fetches HTML/markdown from sites with anti-automation measures using Scrapling.
browser_oxide★ 119
yfedoseev · Rust
Stealth headless browser engine in Rust — native BoringSSL TLS/JA4 fingerprint, real JS via deno_core, no Chromium, no CDP. Python + MCP bindings. A camoufox alternative.
camofox-mcp★ 118
redf0x1 · TypeScript
Anti-detection browser MCP server for AI agents — navigate, interact, and automate the web without getting blocked
anansi★ 118
mdowis · Python
A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server
crawl4ai-mcp-server★ 116
sadiuysal · Python
🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, an
crawlie★ 115
spronta · Rust
Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.
agent-search-mcp★ 112
lennney · TypeScript
Free-first Chinese and English web search MCP using zero-key sources and inspectable evidence.
basemind★ 112
Goldziher · Rust
Full AI context and content layer for coding agents over one MCP server — tree-sitter code-map, document RAG, shared memory, multi-agent comms, web crawl, git history + blame. 300+ languages, 10+ agent harnesses, pure Rust.
vitre★ 108
ggoggam · Kotlin
WebView automation for Kotlin Multiplatform. Run page workflows in an embedded WebView on Android, iOS and desktop, from your app, a test, or an LLM agent over MCP or Koog.
doc-scraper★ 107
Sriram-PR · Go
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
opencode-browser★ 107
michaljach · TypeScript
Browser automation plugin for OpenCode AI editor - Control Chrome/Edge with AI, automate web testing, scraping & form filling via MCP integration
ertugrul59 · Python
MCP server that captures TradingView chart images via Selenium — supports any ticker/interval with browser pooling for concurrent performance
Sharan-Kumar-R · Python
MCP server for scraping LinkedIn, Facebook, Instagram profiles and Google search.
frankensurf★ 97
yail259 · Python
One call that gets your agent through any site, stitched from 28 browsing tools
bzsasson · Python
Headless MCP server for Screaming Frog SEO Spider – run crawls, export and analyze crawl data via the CLI. Small locked-down tool surface for scheduled audits, CI, and unattended AI agents.
kogiqa-mcp★ 93
atagon-GmbH · JavaScript
This web browser has been designed to help your agent debug and develop complex web applications. (MCP Server)
seo-audit★ 85
houtini-ai · TypeScript
Free SEO Audit MCP server for Claude - captures and stores all the raw data you need for a complete technical SEO audit. Google Search Console + a first-party crawl + DataForSEO + Majestic SEO merged into one prioritised audit.
free-proxy-list★ 83
hproxy-com
Free proxy list, verified around the clock: HTTP, HTTPS, SOCKS4 and SOCKS5 proxies with country, anonymity, latency and uptime on every row, updated several times a day. Live list, proxy checker, keyless API and MCP server at hproxy.com.
powhttp-mcp★ 83
usestring · Go
MCP server enabling agents to debug HTTP requests better (using powhttp)
jevcrawl★ 80
RayenMlayeh · Python
MCP server and CLI that crawls websites for AI agents: finds the answer page 2x more often than Crawl4AI, 10x cheaper per answer than letting Claude crawl.
mcp-appstore★ 78
appreply-co · JavaScript
This is an MCP server that provides tools to LLMs for searching and analyzing apps from both Google Play Store and Apple App Store – perfect for ASO.
mcp-service · Python
一个功能强大的多平台自媒体数据采集MCP工具，支持B站、小红书、抖音、快手、抖音微博、贴吧、知乎等主流平台的公开信息抓取。
zoharbabin · Go
Give your AI assistant real web search, full-page reading, and multi-source research with citations that are never fabricated.
cortex-scout★ 70
cortex-works · Rust
A unified web extraction and stateful automation engine for AI. Replaces heavy testing frameworks with token-optimized browser control, deep research, and HITL.
cn-scraper-mcp★ 68
goesByhc · Python
Let AI agents search the Chinese internet via MCP — Taobao, JD, Xiaohongshu, Zhihu, Weibo, Bilibili, ZSXQ, Douban, Dianping, and more.
node-csfd-api★ 65
bartholomej · TypeScript
ČSFD API in JavaScript. Amazing NPM library for scrapping csfd.cz. Now with MCP server
lilbee★ 65
tobocop2 · Python
The whole local AI stack in one executable: it runs and manages local AI models across every GPU, and it's a search engine you can talk to, with cited answers from your files, code, and the web. MCP server for coding agents, web crawler, TUI, CLI, REST API, Python library. No Ollama or LM Studio nee
yangbuyiya · Python
本项目是一个基于 FastMCP 的全网短视频去水印解析服务，支持多平台视频分享链接的解析，自动提取视频真实地址及相关信息。 适用于需要批量解析、去水印、采集短视频的场景。本项目还支持视频内容文本提取功能，可以通过语音识别将视频内容转为文本。
mcp★ 63
supadata-ai · TypeScript
Official Supadata MCP Server - Adds powerful video & web scraping to Cursor, Claude and any other LLM clients.
proxy-scraper★ 62
maximilianfeix · Python
Free HTTP/SOCKS proxies with every check on the record: passed, failed or couldn't run, and when. Hourly list, --pick --verify, --diagnose, rotating proxy, Python API, MCP server.
agent-skills★ 61
Nimbleway · Python
Agent skills that give AI agents live web data — search, scrape, and extract structured data with Extraction Templates and Web Search Agents, plus one-command business intelligence workflows. Plugin and MCP server for Claude Code, Cursor, Codex, and Grok.
crawlbase-mcp★ 60
crawlbase · JavaScript
Crawlbase MCP Server connects AI agents and LLMs with real-time web data. It powers Claude, Cursor, and Windsurf integrations with battle-tested web scraping, JavaScript rendering, and anti-bot protection enabling structured, live data inside your AI workflows.
deepcloak★ 60
Mrbaeksang · Python
Local-first research tool with explicit fetch decisions, source evidence, and cited reports. CLI and MCP interfaces. Python, MIT.
trendspyg★ 59
flack0x · Python
Free, maintained Python library + CLI for Google Trends: trending now, plus keyword interest over time, related queries & interest by region. A modern pytrends alternative.
llm-use★ 59
llm-use · Python
LLM orchestration toolkit for agent workflows: planner + workers + synthesis, optional router (LLM + learned fallback), supports OpenAI/Anthropic/Ollama/llama.cpp, real scraping with caching, MCP server integration, and a TUI chat UI.
FWMA★ 58
JinchengGao-Infty · Python
End-to-end AI literature review automation: crawl, screen, download, multi-agent review, and report generation
OvertliDS · Python
Enhanced MCP server for SearXNG: category-aware web-search, web-scraping, and date/time retrieval.
worldnine · TypeScript
MCP server for Cosense (Scrapbox) — read, search, create, and edit wiki pages from Claude and other AI agents. Also works as a CLI and Claude Code plugin.
mcp-avito★ 54
Ascard · TypeScript
Модульный scraper для Avito с поддержкой CLI, MCP сервера и прокси.
ai-browser-mcp★ 53
AI-XiaoDao · C++
AI浏览器 MCP Server — Windows 本地浏览器自动化 MCP 服务端 · 334 个工具全量真机核验(0 失败/0 闪退) · Cursor/Claude Code/Claude Desktop/Trae 原生 stdio 直连 · Web Scraping · JS 逆向 · CDP 断点 · 指纹反检测 · 网络拦截 · 填表 RPA · FBrowser CEF 内核 · MIT 开源
browsegenie★ 53
PushpenderIndia · Python
AI Agent which can do any kind of Browser Automation Task & Web Scraping, just using a single prompt!
jaenster · TypeScript
Browser automation MCP server for Claude, powered by Puppeteer.
mcp-web-scrape★ 49
mukul975 · TypeScript
🚀 mcp-web-scrape — Clean, cache-aware web content fetcher for AI agents. Fetch any URL → extract readable content → return Markdown/JSON with citations. ⚡ Fast caching, 🤝 robots.txt compliant, 📝 Markdown-ready output, �� works with ChatGPT/Claude Desktop.
00200200 · Python
Curated developer tools, AST analyzers, and automated verification workflows.
nodemaven · Python
Self-hosted Google search scraper for Python. Scrape Google SERP results with a real Chrome browser and your own residential proxy. Self-hosted SERP API alternative with JSON output, an HTTP API and an MCP server for AI agents.
fatsearch★ 48
fatsearch · Rust
Search and read the web for AI agents at 99% fewer tokens. Free CLI + MCP.
crawl-mcp★ 48
walksoda · Python
Crawl4AI MCP Server: Extract content from web pages, PDFs, Office docs, YouTube videos with AI-powered summarization. 17 tools, token reduction, production-ready.
luxiaolei · TypeScript
Self-hosted MCP server with SearXNG + Crawl4AI for fast search and reliable web scraping in Claude Code. 3x faster than native tools with 100% scraping reliability.
crawl4ai-rag-mcp★ 47
ToKiDoO · Python
A self-contained MCP server in docker that combines the Crawl4AI, SearXNG, and Supabase to provide AI agents and coding assistants with complete web search, crawling, and RAG capabilities.
pragmar · Python
MCP server tailored to connecting web crawler data and archives
Agent402★ 45
MikeyPetrillo · JavaScript
agent402.tools: 500+ pay-per-call tools, metered models and finished reports for AI agents, paid per call in USDC over x402 and MPP or by card. Open source, self-hostable, MCP-native. The applied layer of agentic finance.
crawl4ai-mcp-llm★ 45
laurentvv · Python
Web crawling tool that integrates with AI assistants via the MCP
Qurio★ 45
havingautism · JavaScript
Qurio brings multi-provider models, custom agents, reusable skills, MCP servers, HTTP tools, retrieval, long-term memory, Deep Research, and Scrapbook into one operating surface.
webscraping-ai · JavaScript
A Model Context Protocol (MCP) server implementation that integrates with WebScraping.AI for web data extraction capabilities.
AgentStack★ 44
ssdeanx · TypeScript
AgentStack is a production-grade multi-agent framework built on Mastra, delivering 50+ enterprise tools, 25+ specialized agents, and A2A/MCP orchestration for scalable AI systems. Focuses on financial intelligence, RAG pipelines, observability, and secure governance. ACP Openclaw, Gemini CLI, Openco
vaaya-mcp★ 44
vaaya-ai · JavaScript
Paid APIs and supported tokenized shares for agents, funded with prepaid balance. Instinct Checkout guidance: https://vaaya.ai/llms.txt
sitewalk★ 43
adityaarsharma · Python
Sitewalk: SEO Audit & Site Crawler. 30+ technical SEO checks. Use it in ChatGPT with no install, or self-host the open-source crawler and MCP server for Claude Code, Cursor and Codex. SEO growth agent included. Powered by LibreCrawl. MIT.
Agent-Span★ 43
oxbshw · Rust
The Web Access Gateway for AI Agents — 52 channels, 92 MCP tools, 9 SDKs, self-healing backends, async Rust
veilbrowser★ 43
acunningham-ship-it · TypeScript
Stealth browser for AI agents — real Chrome over raw CDP, no Playwright/Puppeteer. TypeScript + MCP-native. Passes sannysoft 57/57, bypasses Cloudflare.
aginxbrowser★ 41
yinnho · Rust
Agent-first browser in one Rust binary — own V8 and diting_runtime (no Chromium). HTTP API for markdown fetch, JS/SPA render, screenshots, 20-engine meta-search, interactive sessions, and stealth TLS. Puppeteer/Playwright alternative for AI agents.
webfetch-mcp★ 40
manooll · JavaScript
Live Web Access for Your Local AI — Tunable Search & Clean Content Extraction
Bowenwin · Python
MCP_Server for MediaCrawler. To Use MediaCrawler conveniently
plasmate★ 38
plasmate-labs · Rust
Browser engine for agents. HTML in, structured Semantic Object Model out. Native MCP and AWP with a supported CDP subset. Apache-2.0.
crawl-mcp★ 38
wutongci · TypeScript
完整的微信文章抓取MCP服务器 - 基于Model Context Protocol (MCP)的智能网页抓取工具，专为Cursor IDE和AI工具设计。
mcp-server★ 37
Decodo · TypeScript
The Decodo MCP server which enables MCP clients to interface with services.
ismailsaoulaj · Python
A production-grade Model Context Protocol (MCP) server. Empowers AI assistants (Claude, Cursor) to search, fetch, and analyze Reddit discussions with resilient rate-limiting and smart LLM noise filtering.
auth-fetch-mcp★ 36
ymw0407 · TypeScript
MCP server that lets AI assistants fetch content from authenticated web pages.
subio-mcp★ 35
alijancb · TypeScript
MCP server that scrapes public posts from X, LinkedIn and Hacker News in a local browser that is never signed in
WEBGhosting-MCP★ 33
yranjan06 · Go
Intelligent stealth browser MCP server for AI agents with 30 tools, 22 anti fingerprint scripts, and LLM powered extraction. Works seamlessly with Cursor, Claude, VS Code, and any OpenAI compatible LLM.
cdpilot★ 32
mehmetnadir · Python
Browser automation CLI on raw CDP — no Puppeteer, Playwright or Selenium, 0 npm dependencies. 70+ commands, test assertions, click/fill by visible text without an LLM, and an MCP server for AI coding agents.
2captcha-mcp★ 31
2captcha · JavaScript
2Captcha MCP server for AI agents with web search, web scraping, browser automation, captcha solving, and scalable web data collection.
DLHellMe · TypeScript
Powerfull Telegram MCP for Claude Desktop to scrape and analyze Telegram content.
BjornMelin · Shell
Pinned, tested distribution of upstream Crawl4AI with MCP client setup and deployment guidance.
browser-rs-mcp★ 30
maestrojeong · Rust
Lightweight stealth-oriented browser MCP server in Rust — one shared Chrome for many AI agents, 64+ Playwright-style tools, no Node.js runtime.
codedox★ 30
chriswritescode-dev · Python
A powerful system for crawling documentation websites, extracting code snippets, and providing fast search capabilities via MCP (Model Context Protocol) integration.
extrawest · JavaScript
A scalable AI chatbot platform built with FastAPI and LangGraph, featuring multi-agent orchestration, multi-tenant vector storage, cross-chat memory, and voice call capabilities through LiveKit integration.
nudlers★ 29
enudler · TypeScript
Smart personal finance tracker for Israeli banks & cards. Features AI categorization, recurring payments, self-hosting (Docker), and MCP support.
DevinoSolutions · Python
Undetectable browser automation for AI agents via MCP. Stealth Chrome DevTools with smart profile management, anti-detection arg filtering, and CDP access.
spectrawl★ 28
Pyx-Corp · JavaScript
The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.
docpull★ 28
raintree-technology · Python
Local-first Python CLI and MCP server for versioned, cited context from web and document sources.
digcrawl★ 28
originaleric · Go
Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI.
persist-1 · Python
The Model Context Protocol (MCP) service based on DrissionPage provides AI assistants with powerful browser automation capabilities. | 基于 DrissionPage 的模型上下文协议 (MCP) 服务，为 AI 助手提供强大的浏览器自动化能力。
qt-web-extractor★ 27
wszqkzqk · Python
Multimodal web content extraction engine backed by Qt WebEngine.
pinkpixel-dev · JavaScript
A Model Context Protocol (MCP) compliant server designed for comprehensive web research. It uses Tavily's Search and Crawl APIs to gather detailed information on a given topic, then structures this data in a format perfect for LLMs to create high-quality markdown documents.
WEB-SCRAPING-MCP★ 27
MaitreyaM · Python
MCP Server leveraging crawl4ai for web scraping and LLM-based content extraction (Markdown, text snippets, smart extraction). Designed for AI agent integration.
finance-mcp★ 26
FlowLLM-AI · Python
LLM-powered MCP server for building financial deep-research agents, integrating web search, Crawl4AI scraping, and entity extraction into composable analysis flows.
takiAA · JavaScript
Twitter/X MCP server for AI agents: search, timelines, threads and profiles via local twscrape sessions, credential-free public tweet lookup, and opt-in posting/deletion.
levz0r · JavaScript
MCP server for converting HTML to Markdown using Turndown.js. Fetch web pages and convert them to clean, formatted Markdown.
taobao_mcp★ 26
JeremyDong22 · Python
MCP server for Taobao/Tmall product scraping integration with Claude
searxng-mcp★ 25
TadMSTR · TypeScript
Private web search MCP: SearXNG metasearch → ML reranking → 4-tier fetch cascade (Firecrawl / Crawl4AI / raw / Wayback) with per-domain learning, Ollama query expansion and synthesis. No cloud APIs.
larapanda★ 25
ferdiunal · PHP
Type-safe Lightpanda SDK for Laravel and PHP with named instances, auto CLI/Docker runtime resolution, MCP integration, and strict markdown/semantic tree outputs.
RAGStack-Lambda★ 25
HatmanStack · Python
Search, chat, upload, and scrape a serverless RAGStack knowledge base on AWS.
ui-annotator-mcp★ 21
mcpware · JavaScript
MCP server that annotates any web page with hover labels — zero extensions, works in any browser
FlorianBruniaux · Python
96 MCP tools for Google Search Console, Bing, GA4 and CrUX: SEO audits, traffic diagnostics, local crawl evidence, guarded submissions, Claude/Codex playbooks and opt-in bounded native workflows.
svipall★ 20
ilien-dev · Rust
Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.
wet★ 19
n24q02m · Python
Open-source MCP server for AI agents: web search, content extraction, and library docs -- 5-strategy scraping, runs without API keys.
cbrowser★ 19
alexandriashai · TypeScript
Cognitive Browser: The browser automation that thinks. Constitutional safety • Persona UX testing • Natural language interface • Self-healing selectors • Built for AI agents
agent-lighthouse★ 17
ForkPoint · TypeScript
Lighthouse-style audits for AI agents, LLM crawlers, MCP clients, and the agentic web.
cli★ 16
ZenRows · TypeScript
Zero-config CLI that gives AI agents reliable access to protected web data through Zenrows — Fetch, Extract, Batch, and Browser Sessions, plus MCP setup and agent skills. No API key needed to start.
HasData · JavaScript
Hosted Google Search / SERP MCP server from HasData, no Google Cloud project. Organic results, AI Overview, People Also Ask, AI Mode, news and shopping for Claude, Cursor and any MCP client.
instagram-mcp★ 15
HasData · JavaScript
Hosted Instagram MCP server from HasData. Public profile and post-feed tools by handle, structured JSON, for Claude, Cursor and any MCP client.
pubcrawl★ 15
nickjlamb · TypeScript
MCP server giving AI assistants verifiable access to PubMed, Europe PMC, US/UK drug labelling, and ClinicalTrials.gov. Built by PharmaTools.AI.
KyuRish · Python
Unofficial, independent MCP server for searching public Fiverr gig listings. Not affiliated with or endorsed by Fiverr.
linkedin-mcp★ 12
devag7 · TypeScript
LinkedIn for AI assistants (MCP) — profiles, people/job/company search, feed & messaging as structured JSON, plus gated writes (connect/message/post/react/comment) via LinkedIn's API instead of DOM-clicking. Stealth-browser engine, 22 tools, built-in safety layer. Claude · Cursor · any MCP client.
serkan-ozal · TypeScript
The Driflyte MCP Server exposes tools that allow AI assistants to query and retrieve topic-specific knowledge from recursively crawled and indexed web pages.
glassdoor-mcp★ 11
HasData · JavaScript
MCP server for Glassdoor: search job listings by keyword and location, read one posting in full with the employer rating and the salary figure with its provenance. 1,000 free credits every month.
indeed-mcp★ 11
HasData · JavaScript
Indeed MCP server by HasData: search job listings and read full postings, as JSON.
tiktok-mcp★ 11
HasData · JavaScript
TikTok MCP server by HasData: public profiles, videos, comments and keyword search as JSON, over streamable HTTP.
booking-mcp★ 11
HasData · JavaScript
Booking.com MCP server by HasData: search stays and read full property details, as JSON.
facebook-mcp★ 11
HasData · JavaScript
MCP server for Facebook: a public page or profile by handle with likes, followers, contact details and the post feed with reactions. No Meta developer app. 1,000 free credits every month.
block-town · Python
MCP server for the Google Ads Transparency Center — look up any advertiser's ads without an API key
yelp-mcp★ 10
HasData · JavaScript
MCP server for Yelp: business search, place details and the full review feed as JSON. Hosted, no Yelp Fusion key. 1,000 free credits every month.
amazon-mcp★ 10
HasData · JavaScript
Amazon MCP server by HasData: keyword search, product details, seller profiles and seller catalogues, as JSON.
redfin-mcp★ 10
HasData · JavaScript
MCP server for Redfin: search for-sale, for-rent and sold listings with the full filter set, and read one property page in full. No MLS licence. 1,000 free credits every month.
walmart-mcp★ 10
HasData · JavaScript
MCP server for Walmart: keyword and category search, product pages with the buy box and other sellers, and the review feed with its filter block. 1,000 free credits every month.
web-scraping-mcp★ 10
HasData · JavaScript
MCP server for HasData's Web Scraping API: fetch any public URL through managed proxies, render JavaScript when needed, and get markdown, text, HTML or structured JSON. From 1 credit a call.
zillow-mcp★ 10
HasData · JavaScript
Zillow MCP server by HasData: for-sale, for-rent and sold listings and full property details, as JSON.
rlgrpe · Python
MCP server for browser automation with Camoufox anti-detection capabilities
bing-mcp★ 9
HasData · JavaScript
MCP server for Bing search: organic results, the ad block and the Copilot answer, with geo, market and language targeting. No Azure subscription. 1,000 free credits every month.
HasData · JavaScript
MCP server for Yellow Pages: search local businesses by keyword and location, read one listing in full with services, brands and payment methods. 1,000 free credits every month.
cf-browser★ 9
claude-world · Python
Open-source Cloudflare Browser Rendering proxy — 10 MCP tools for Claude Code (content, screenshot, PDF, markdown, scrape, JSON AI extraction, links, a11y, crawl)
airbnb-mcp★ 8
HasData · JavaScript
Airbnb MCP server by HasData: search stays and read full listing details, as JSON.
HasData · JavaScript
MCP server for Google Images: image search with size, colour and type filters, 100 results a call with the source page and the full-resolution URL. 1,000 free credits every month.
HasData · JavaScript
Hosted Google Maps MCP server from HasData, no Google Cloud project needed. Search places, reviews, contributor history, photos and posts for Claude, Cursor and any MCP client.
AjnasNB · JavaScript
Give AI agents bounded eyes on the public web: crawl, search, and normalize evidence without an unrestricted browser.
mugoosse · Python
MCP server for fetching, parsing and crawling sitemaps of a given website
Solihatun1 · Python
A powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to easily generate web scrapers for various types of websites.
mcp★ 7
fouradata · JavaScript
MCP server for the FourA web scraping API - four tools, six prompts, one API key.
HasData · JavaScript
Hosted DuckDuckGo MCP server from HasData. Ranked results, ads separated, 37 regions, structured JSON for Claude, Cursor and any MCP client.
shopify-mcp★ 7
HasData · JavaScript
MCP server for Shopify storefronts: pull the public product catalogue and collections of any store by URL, with variants, SKUs and prices. No app, no merchant token. 1,000 free credits every month.
youtube-mcp★ 7
HasData · JavaScript
Hosted YouTube MCP server from HasData, no Google Cloud project needed. Search, video, channel and transcript tools for Claude, Cursor and any MCP client.
crawl4ai-mcp★ 7
stgmt · JavaScript
Model Context Protocol (MCP) server for Crawl4AI with HTTP transport, Bearer token authentication, and remote deployment support
Mehmoodqureshi · TypeScript
MCP browser extension and server for your signed-in Chrome. Real sessions, deny-all site allowlist, 43 tools.
HasData · JavaScript
Google Flights MCP server by HasData: fares, flight legs, carbon emissions and price history, as JSON.
andresolbach · Python
Give your AI agent a full Chrome workspace. 70 MCP tools powered by nodriver: browse, extract data, capture network traffic and inspect security. Reuse logins, run isolated browsers and restore your tabs. One-command setup for 15+ clients.
ofershap · TypeScript
MCP server for web scraping — extract clean markdown, links, metadata from any URL
HasData · JavaScript
Google Trends MCP server by HasData: interest over time, by region, and related queries and topics, as JSON.
AKzar1el · Python
Google News + Google Trends MCP server for keyword, market, SEO, and content research. Free OSS.
apiguru-mcpnpm package
GitHub Actions · JavaScript
Live Amazon marketplace data for AI agents as MCP tools: product details, reviews, keyword search, best-sellers, deals, live offers and stock, and seller profiles across 20 countries. `npx apiguru-mcp` needs only Node 18+ - no Python, no uv, no API key.
crawlforge-mcp-servernpm package
slacey75 · JavaScript
CrawlForge MCP Server - Professional Model Context Protocol server with 31 web scraping, crawling, deep-research, and autonomous-extraction tools. Returns clean Markdown and structured JSON for Claude, Cursor, and any MCP client. Defaults to local Ollama
apick-mcpnpm package
codelineinc · JavaScript
APICK MCP — 174 Korean data, AI, image & video tools for AI agents. 사업자조회·신분증·OCR·배송조회·차량제원·이미지 생성·편집·영상 생성·파일변환·검색·LLM.
@rankcli/mcp-servernpm package
GitHub Actions · JavaScript
Free, local SEO + GEO (AI-search-citation) analysis for AI assistants - audits GEO/AI-crawler access, Core Web Vitals, structured data, security headers, mobile, and images with no signup or API key.
@yawlabs/fetch-mcpnpm package
jeffyaw · JavaScript
Fetch MCP server for AI agents: HTTP requests, HTML-to-markdown, reader mode, metadata, links, sitemaps, RSS/Atom, robots.txt, SSRF-safe
scrapercitynpm package
scrapercity · JavaScript
ScraperCity CLI & MCP Server - B2B lead generation for AI agents
@stophy/mcpnpm package
GitHub Actions · JavaScript
Web scraping API for AI agents. One API to search the web, read what people say, and look up products, places, jobs and homes. Pay only for answers.
crawlora-mcpnpm package
GitHub Actions · JavaScript
Local MCP server for Crawlora — 3665 structured public web-data tools across 472 platform groups (search, maps, commerce, social, finance) wrapping the Crawlora REST API.
@spicrawl/mcpnpm package
spicrawl · JavaScript
MCP server for web scraping: scrape any URL to Markdown or JSON for Claude, Cursor and AI agents, with JavaScript rendering, batch scraping and data extraction
scrape-le-mcpnpm package
nolindnaidoo · JavaScript
Analyse robots.txt content and report whether a path may be crawled.
@vibebrowser/mcpnpm package
vibetechnologies · JavaScript
MCP server that drives your real, logged-in Chrome from any MCP client - including agents on a remote machine, with no inbound port open
@octocrawl/mcpnpm package
GitHub Actions · JavaScript
Octocrawl as an MCP server over stdio, a client of a running Octocrawl API (octocrawl serve).
novada-mcpnpm package
tw260 · JavaScript
One MCP server for all web data. Search, scrape, crawl, proxy, and AI research in one install.
@ainative/browser-mcpnpm package
ainative-studio · JavaScript
AINative Browser Agent MCP Server — 6 AI-powered browser automation tools for web interaction, structured data extraction, page validation, multi-step tasks, and memory enrichment. Auto-detects ZeroLocal vs Cloud.
webpeelnpm package
casas42 · JavaScript
The web data platform for AI agents — fetch, search, crawl, extract, monitor, screenshot. 55+ domain extractors, 65-98% token savings, MCP server included. One API call.
miromiro-mcpnpm package
soraiadev · JavaScript
MCP server for the MiroMiro design-extraction API — give your coding agent the real code, design tokens, assets, SVGs, fonts, and Lottie of any website.
search-memory-mcpnpm package
GitHub Actions · JavaScript
Free web search and long-term memory for AI assistants via MCP. No API keys; cache, memory and index stay local.
alterlab-mcp-servernpm package
GitHub Actions · JavaScript
MCP server for web scraping, structured data extraction, and screenshots — give Claude, Cursor, Windsurf, and AI agents the ability to scrape any website with automatic anti-bot bypass
@apifreaks/mcpnpm package
umar-asad · JavaScript
Official MCP server for APIFreaks. Gives AI agents live weather, WHOIS, DNS, SSL, domain availability/reputation/typosquatting, IP geolocation and threat intelligence, screenshots, PDF, currency, commodities, VAT/IBAN/SWIFT, email validation, disposable-e
eddieseddiesnpm package
eddieseddies · JavaScript
ex420 — x402 for Eddies. Accept payments with a single line of code; HTTP 402 settled in €$ on the Eddies ledger.
roamproxy-mcpnpm package
GitHub Actions · JavaScript
MCP server for RoamProxy: let AI agents fetch pages and get proxies through residential, datacenter and mobile IPs in 190+ countries.
@andrijdavid/vinted-mcpnpm package
andrijdavid · JavaScript
MCP Server for Vinted marketplace — search items, compare prices, analyze sellers across 19 countries.
@j0hanz/fetch-url-mcpnpm package
GitHub Actions · JavaScript
An MCP server that fetches web pages and converts them to clean, readable Markdown.
gate402-mcpnpm package
pgalyen · JavaScript
MCP server for Gate402: pay-per-call agent APIs over x402. Open-model LLM inference, crypto/finance data, SEC filings and web tools. Free tier, no signup.
@bitbooth/mcp-fetchnpm package
whatsrdoing · JavaScript
Discover BitBooth APIs for free, then buy capped x402 fetch, PageDelta, and watch tools over Base USDC or XRPL mainnet RLUSD.
orchard-data-mcpnpm package
le---nguyen · JavaScript
MCP server: pay-per-call market data + agent tools via x402 (USDC on Base). Web page reader, email verification, token safety, sentiment, prediction markets, regime forecasts, quotes, macro.
auxiliar-mcpnpm package
alextakayama · JavaScript
Eval-backed tool discovery for AI agents on the auxiliar.ai web-access gateway. recommend_tools picks the best search, scraping, browser-automation or voice provider for a job from measured benchmarks (quality, latency, cost, error rate), returning routes
@proxies-sx/mcp-servernpm package
proxies.sx · JavaScript
MCP server for residential and mobile proxies: AI agents get rotating and sticky proxy URLs (HTTP/SOCKS5), live stock per country, IP rotation, usage and billing. Proxies.sx Pool Gateway, metered per GB.
@melis-ai/x402-tools-mcpnpm package
smelis · JavaScript
22 x402 pay-per-call utility tools for AI agents — scrape, validate, embed, store, moderate, notify, convert, prevent loops. No accounts, no API keys. USDC on Base via the x402 protocol.
insightsocialnpm package
GitHub Actions · JavaScript
Official CLI and MCP server for the InsightSocial API: 300+ social data endpoints across 25 platforms (Instagram, TikTok, LinkedIn, Facebook, YouTube, X, Reddit, Bluesky, Telegram, Douyin, Weibo and more) behind one key.
@crawlspec/mcpnpm package
mtaoxuan · JavaScript
MCP server for CrawlSpec: run a free SEO audit of any site you own, then read its recommendations, briefs, keywords and page audits from your agent.
apexapi-mcpnpm package
nitrotech · JavaScript
MCP server for ApexApi — call 120+ AI models and live web context (scrape/crawl/extract) from any MCP client with one ak- API key
@evascrape/mcpnpm package
evascrape · JavaScript
MCP server for Evascrape: find business leads with email addresses from Google Maps, Apollo.io and LinkedIn.
@opencraw/mcpnpm package
russoedu · JavaScript
An MCP server exposing OpenCraw's crawler as agent tools: probe a page, validate recipes, run a crawl, list recipes.
@bycrawl/mcpnpm package
kevinleeeee · JavaScript
MCP server for ByCrawl — query 15+ social media platforms (Threads, X, Facebook, Reddit, LinkedIn, TikTok, Instagram, YouTube) from AI agents
scrapeloop-mcpnpm package
GitHub Actions · JavaScript
Scrapeloop MCP server - set up and run Scrapeloop end-to-end (integrations, scraping, lead database, verification, cleaners, enrichment, strategies, Instantly campaigns) from any MCP client (Claude Desktop, Cursor, ChatGPT, …).
lasso-mcpnpm package
wangdong233 · JavaScript
Claude Code 的全交互对外抓手 MCP —— 搜/抓/登录态抓/控桌面，四通道+多引擎 fallback+AES cookie+markdown 抽取。All-in-one interaction MCP for Claude Code.
@first-ch/tools-mcpnpm package
GitHub Actions · JavaScript
First CH Tools の計算ロジック（WCAGコントラスト比・文字数/Xウェイト・WebP変換・JSON-LD生成・llms.txt生成・文字コード/改行コード変換・Marp Markdown→スライド レンダリング・テストデータ生成・テキスト/コード差分・Cron式の解説・Base64/Data URI変換・URLパラメータの分解/再構築・HTML特殊文字のエスケープ/エンティティのデコード・JSON⇄YAMLの相互変換・px⇄rem/emの単位換算とCSSの一括変換・カラーコードの相互変換とア
@marrowdev/browse-mcpnpm package
takaki2 · JavaScript
Drive your own Chrome from an AI agent, with its logins intact. A local stdio MCP server: it maps what a page affords, acts on it, and hands the keyboard back to you for logins, 2FA and CAPTCHAs instead of solving them.
@kadoa/mcpnpm package
GitHub Actions · JavaScript
Kadoa MCP Server — manage workflows from Claude Desktop, Cursor, and other MCP clients
socialcrawl-mcpnpm package
ridiodevs · JavaScript
One unified API for social and web data — social media (incl. Douyin, Xiaohongshu, Telegram, Quora, Bluesky, Apple Music, Product Hunt), commerce, marketplaces & product reviews, retail (Amazon, Walmart, Target, Home Depot, eBay, Klarna, AliExpress, Etsy,
@crawlbrulee/mcpnpm package
GitHub Actions · JavaScript
official mcp server for crawlbrulee — EU-native web scraping for AI agents & developers. native scrape and map tools for your agent.
poltertabnpm package
abhinav162 · JavaScript
Let any AI assistant drive and scrape your existing Chrome profile — no headless browser, no complex setup.
@page2ai/mcpnpm package
GitHub Actions · JavaScript
MCP server that converts any web page URL to clean Markdown for LLM context. Processing is local and SSRF-guarded; no external APIs, no telemetry.
@mcp-b/smart-dom-readernpm package
GitHub Actions · JavaScript
Token-efficient DOM extraction for AI agents - Extract interactive elements, semantic structure, and stable CSS selectors for LLM-powered browser automation
linkedin-relay-mcpnpm package
tamas_gabor · JavaScript
Deep research over LinkedIn from your own account — CLI (lnrelay) + read-only MCP server + Claude Code skill. No paid API. Reads LinkedIn's private Voyager surface with your own session cookies.
@domscout/mcpnpm package
GitHub Actions · JavaScript
domscout browser API as MCP tools: screenshots, Markdown, structured data, page automation, crawls.
opedd-mcpnpm package
opedd · JavaScript
Content licensing for the AI era. Licensed, rights-cleared content for AI agents, with a verifiable license key for every article. The MCP alternative to unlicensed scraping for RAG and AI search.
crawl-readiness-mcpnpm package
grubbomatic · JavaScript
MCP server for Crawl Readiness — check AI readiness, validate schema/robots.txt, generate AI SEO files (llms.txt, robots.txt, JSON-LD), and read LLM Monitor share-of-voice trends directly from Claude, Cursor, and other MCP clients.
@imenam/simple-scrapernpm package
imenam · JavaScript
MCP server for web scraping and JavaScript execution using Puppeteer
search-rotationnpm package
GitHub Actions · JavaScript
Round-robin web search over the free tiers of multiple search APIs (Tavily, Firecrawl, Parallel, Exa, Google PSE, Jina, DuckDuckGo) as an MCP server — with a local dashboard for API keys, engine order/toggles and live quota status.
sitemothnpm package
recurpost · JavaScript
Sitemoth: desktop-class SEO crawler engine, CLI and MCP server (crawl, 180 checks, exports, Search Console, GA4, PageSpeed, spelling, accessibility).
quanticdata-mcpnpm package
quantumproxies · JavaScript
MCP server for the QuanticData API — scrape, search, map, crawl the web and pull residential/datacenter/mobile proxies for AI agents. Connect QuanticData to Claude, Cursor, and any MCP client.
scrapeunblocker-mcpnpm package
GitHub Actions · JavaScript
Model Context Protocol (MCP) server for ScrapeUnblocker - lets Claude fetch any web page's HTML (or AI-parsed JSON) and run 100+ site plugins that return structured JSON, through the ScrapeUnblocker anti-bot API, using your own API key.
@pline/api-linux-x64npm package
pline.ai · JavaScript
linux/x64 binary for the pline-mcp MCP server. Install `pline-api` instead of this package.
crawlmark-mcpnpm package
idrewlong · JavaScript
MCP server for automated SEO audits and reports: Google Search Console, GA4, Tag Manager, DataForSEO, Lighthouse and axe-core
quantumproxies-mcpnpm package
quantumproxies · JavaScript
MCP server for the QuantumProxies API — scrape, search, map, and crawl the web through residential proxies, and hand AI agents ready-to-use proxies of every type (residential, mobile, datacenter, ISP, IPv6). Connect QuantumProxies to Claude, Cursor, and a
@mambalabsdev/mcp-creator-profile-readernpm package
mambalabsdev · JavaScript
MCP server for the Mamba Labs Influencer Profile Scraper actor on Apify. Creator handles or profile URLs in, one profile row out per creator.
@pline/api-win32-x64npm package
pline.ai · JavaScript
win32/x64 binary for the pline-mcp MCP server. Install `pline-api` instead of this package.
pline-apinpm package
pline.ai · JavaScript
MCP server for pline.ai: scrape, crawl, batch-scrape, map, and search the web. Run with `npx -y pline-api`.
@true402.dev/mcp-servernpm package
true402.dev · JavaScript
MCP server for the true402 machine-native marketplace — pay-per-call AI + web + Base on-chain tools over x402 (USDC on Base): LLM inference, SEO/GEO audit, web extract, link preview, robots/AI-crawler check, security headers, and on-chain DeFi trading sig
opengraph-io-mcpnpm package
GitHub Actions · JavaScript
MCP server for OpenGraph.io — fetch web/social data, screenshots, scrape, extract, convert to Markdown, generate images, and audit site SEO & link previews.
@atlascompiler/mcpnpm package
redcliffe · JavaScript
Official Model Context Protocol (MCP) server for Atlas - Deterministic Zero-LLM Web Compiler and Scraper for AI Agents
olostep-mcpnpm package
olostep · JavaScript
API to search, extract and structure web data. Features web scraping, AI-powered answers with citations, batch processing (10k URLs), and autonomous site crawling for AI agents and LLMs.
@pline/api-darwin-arm64npm package
pline.ai · JavaScript
darwin/arm64 binary for the pline-mcp MCP server. Install `pline-api` instead of this package.
caishi-mcpnpm package
zhongquinnking · JavaScript
Self-contained MCP server. Read Chinese platforms from any MCP client: Bilibili, Douyin, Xiaohongshu and any web page, through your own logged-in browser session.
polite-crawlernpm package
GitHub Actions · JavaScript
A polite web crawler for research and AI agents. It fetches a source once, keeps it, and reads it many times: robots.txt obeyed, one request per site, full-text search. The MCP server is the package polite-crawler-mcp.
creatorscore-mcpnpm package
creatorscore · JavaScript
Model Context Protocol server for CreatorScore. Lets brands and agencies vet creators, influencers, and athletes from inside Claude, ChatGPT, or any MCP client. Thin client over the public CreatorScore API — it never touches scraping, ML, or any provider
@hasdata/google-hotels-mcpnpm package
GitHub Actions · JavaScript
MCP server for Google Hotels through HasData's hosted API: hotels and vacation rentals with nightly and total rates, price comparisons across booking sites, ratings, amenities and images. 1,000 free credits every month.
mambalabsdev · JavaScript
MCP server for the Mamba Labs Link in Bio Scraper and Newsletter Detector actor on Apify. Creator handles or link in bio URLs in, a newsletter verdict and contact details out.
@pline/api-darwin-x64npm package
pline.ai · JavaScript
darwin/x64 binary for the pline-mcp MCP server. Install `pline-api` instead of this package.
@pline/api-linux-arm64npm package
pline.ai · JavaScript
linux/arm64 binary for the pline-mcp MCP server. Install `pline-api` instead of this package.
seo-geo-mcp-servernpm package
GitHub Actions · JavaScript
MCP server for SEO and GEO (Generative Engine Optimization) audits — on-page SEO, structured data, robots.txt, sitemaps, hreflang, and AI-crawler access for ChatGPT, Claude, Perplexity and Gemini. No API keys required.
fetcher-mcpnpm package
jaeger · JavaScript
MCP server for fetching web content using Playwright browser
smart-web-mcpnpm package
GitHub Actions · JavaScript
Local MCP for web search, direct-URL fetch, site crawling, docs export, and bounded smartbrowser local browser actions.
reckernpm package
fforattini · JavaScript
Multi-Protocol SDK for the AI Era - HTTP, WebSocket, DNS, FTP, SFTP, Telnet, HLS unified with AI providers and MCP tools
@timurtekb/tekjobsnpm package
GitHub Actions · JavaScript
A local-first job-search machine: watches hundreds of company job boards, scores every posting against your profile, and files matches into a folder of markdown notes you own. Bring your own LLM through MCP.
scrapeloop-skillnpm package
GitHub Actions · JavaScript
Set up and operate Scrapeloop with its workspace Playbook and MCP tools.
@isoldex/sentinelnpm package
GitHub Actions · JavaScript
AI-powered browser automation with Gemini – fast, cheap Stagehand alternative
@page2ai/corenpm package
GitHub Actions · JavaScript
Extract clean Markdown from any web page HTML. Works in Node.js (via linkedom) and browsers. Powers the @page2ai/mcp server.
opencode-wyvernnpm package
rhaegal222 · JavaScript
Setup modulare per OpenCode: SSH, client PowerShell/bash (comandi oc-*), configurazione server opencode, provider, plugin, MCP market e comandi custom. Installi tutto, attivi quello che vuoi.
basemindnpm package
GitHub Actions · JavaScript
Full AI context layer over MCP — tree-sitter code-map, document RAG (PDF/Office/HTML/email + OCR + reranker), shared agent memory, on-demand web crawl, git history + blame + per-symbol diff. 300+ languages, 10+ coding-agent harnesses, content-addressed Fj
@particle-academy/fancy-termnpm package
GitHub Actions · JavaScript
Human+ Terminal for React — a controlled, themeable <Terminal> wrapping xterm.js, with hooks and an MCP-bridgeable surface so embedded agents read the buffer, write input, and run commands without DOM-scraping.
@forkpoint/agent-lighthouse-corenpm package
forkpoint · JavaScript
Core TypeScript engine for auditing websites for AI-agent readiness, LLM crawler access, MCP discovery, structured data, and agentic web signals
Frequently asked questions
What is the best MCP server for web scraping?
By GitHub stars, the most adopted web scraping entries on MCP Harbor are browser-use (★119,003), Agent-Reach (★101,437) and Scrapling (★89,376). Popularity is a starting point only. Check whether the project is maintained by the vendor, when it was last updated and which permissions it needs, then try it on a test account before giving it real credentials.
How do I add an MCP server for web scraping?
Open a listing below, copy the package name or server URL from its README, and add it to your client: claude mcp add in Claude Code, mcpServers in Cursor or Claude Desktop, servers in VS Code. The install guide has copy-paste config for each one.
How many web scraping MCP servers are there?
MCP Harbor currently lists 412 projects that match web scraping. 276 of them were updated in the last 30 days and 91% of the GitHub projects carry an open-source license. The list is rebuilt every day from the official MCP Registry, GitHub, npm and PyPI, so a new server shows up here on the first daily update after it meets the listing criteria.
MCP servers for other tools
Data last updated . Stars and downloads are refreshed every day from GitHub and npm.