digcrawl

by originaleric · Search & Web · ★ 28

digcrawl is an MCP server by originaleric. Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI. It has 28 GitHub stars and ranks #240 of 746 in Search & Web by stars.

Category: Search & Web
Author: originaleric
GitHub stars: 28
This week: Tracking since 22 Oct 2026
Language: Go
License: MIT (open source)
Last update: 2026-10-21 (3 days ago)
Links: Source Website

agent-skills
ai-agents
cli
content-extraction
golang
local-first
mcp
social-media
web-crawler
web-scraping

How to install digcrawl

Install steps differ per project, so follow the README in the digcrawl repository. Most MCP servers start with a single command (npx -y <package>, uvx <package> or a Docker image) that you add to your client's config. The install guide shows where that goes in Claude Code, Claude Desktop, Cursor and VS Code.

Also listed in

MCP servers for web scraping412

Maintain this project? Get it featured ($99/mo, pinned at the top of Search & Web) or see what featuring includes.

Report a problem with this listing

Frequently asked questions

What is digcrawl?

digcrawl is an MCP server by originaleric in the Search & Web category. Built by Dig: A local-first content crawler for AI agents. Retrieve web pages, posts, images, and videos from public and user-authorized signed-in sources via Agent Skills, MCP, and CLI. It has 28 GitHub stars and ranks #240 of 746 in Search & Web by stars.

Is digcrawl free and open source?

Yes. digcrawl is published under the MIT license, so you can run, modify and self-host it at no cost. If it connects to a paid service, that service's own pricing and API terms still apply. Check the repository for the exact license text before using it commercially.

What are the alternatives to digcrawl?

Other Search & Web projects on MCP Harbor include Scrapling, TrendRadar, repomix. Each alternative links to its own page with stars, license and recent activity. The Search & Web category ranks all 746 by stars, and you can re-sort it by growth this week.

Alternatives to digcrawl

ScraplingTrending★ 89,376

D4Vinci · Python+1,131 stars this week (+1.3%)

🕷️ A Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

TrendRadar★ 63,148

sansan0 · Python+171 stars this week (+0.3%)

⭐AI-driven public opinion & trend monitor with multi-platform aggregation, RSS, and smart alerts.🎯 告别信息过载，你的 AI 舆情监控助手与热点筛选工具！聚合多平台热点 + RSS 订阅，支持关键词精准筛选。AI 智能筛选新闻 + AI 翻译 + AI 分析简报直推手机，也支持接入 MCP 架构，赋能 AI 自然语言对话分析、情感洞察与趋势预测等。支持 Docker ，数据本地/云端自持。集成微信/飞书/钉钉/Telegram/邮件/ntfy/bark/slack 等渠道智能推送。

repomix★ 29,005

yamadashy · TypeScript+131 stars this week (+0.5%)

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

open-seoTrending★ 24,721

every-app · TypeScript+829 stars this week (+3.5%)

Open source alternative to Semrush and Ahrefs

apify-mcp-serverTrending★ 12,865

apify · TypeScript+1,179 stars this week (+10.1%)

The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.

Horizon★ 10,982

Thysrael · Python+347 stars this week (+3.3%)

📡 Your own AI-powered news radar. Generates daily briefings in English & Chinese. | 用 AI 构建你专属的新闻雷达

All 746 Search & Web MCP servers →

Data last updated 25 October 2026. Stars and downloads are refreshed every day from GitHub and npm.