Web Crawler MCP Server
by dhannusch · Added 26d ago
50
Install
git clone https://github.com/dhannusch/smart-web-crawler-mcpAbout
A Model Context Protocol (MCP) server providing intelligent web crawling capabilities using Cloudflare Workers with browser rendering and AI-powered link extraction. Requires configuration of GitHub OAuth credentials and Cloudflare KV namespace via environment variables and Wrangler secrets.
Tags
browser-webmcp-serverbrowsergitai