crawlie
crawlie is an MCP server by spronta. Fast, free, open-source technical SEO + GEO crawler: built for humans and agents. It has 115 GitHub stars and ranks #114 of 746 in Search & Web by stars.
- Category
- Search & Web
- Author
- spronta
- GitHub stars
- 115
- This week
- Tracking since 18 Oct 2026
- Language
- Rust
- License
- Other
- Last update
- 2026-07-18 (3 months ago)
- Links
- SourceWebsite
How to install crawlie
Install steps differ per project, so follow the README in the crawlie repository. Most MCP servers start with a single command (npx -y <package>, uvx <package> or a Docker image) that you add to your client's config. The install guide shows where that goes in Claude Code, Claude Desktop, Cursor and VS Code.
Also listed in
Maintain this project? Get it featured ($99/mo, pinned at the top of Search & Web) or see what featuring includes.
Report a problem with this listing
Frequently asked questions
What is crawlie?
crawlie is an MCP server by spronta in the Search & Web category. Fast, free, open-source technical SEO + GEO crawler: built for humans and agents. It has 115 GitHub stars and ranks #114 of 746 in Search & Web by stars. It is written in Rust. It is licensed under Other. It was last updated 3 months ago.
Is crawlie free and open source?
crawlie lists its license as Other. Read the license text in the repository before using it in a commercial product, and check whether the service it connects to charges for API access.
What are the alternatives to crawlie?
Other Search & Web projects on MCP Harbor include Scrapling, TrendRadar, repomix. Each alternative links to its own page with stars, license and recent activity. The Search & Web category ranks all 746 by stars, and you can re-sort it by growth this week.
Alternatives to crawlie
All 746 Search & Web MCP servers →
Data last updated . Stars and downloads are refreshed every day from GitHub and npm.