agent-web-scraper-mcp

by aparajithn · ai-ml · mcp-server, glama

Web scraping MCP server for Al agents. 6 tools: extract clean text/markdown from any URL, structured scraping with CSS selectors, full-page screenshots via Playwright, link extraction with regex filtering, metadata extraction (OG tags, Twitter cards), and Google search. Free tier: 50 requests/IP/day.

Source: https://github.com/aparajithn/agent-scraper-mcp

Install

git clone https://github.com/aparajithn/agent-scraper-mcp

Tags: mcp-server, glama

Source: glama

About ai-ml MCP servers and Claude skills

ai-ml MCP servers extend what AI agents can do inside Claude Code, Cursor, Copilot, Codex, and Windsurf. The Skiln directory indexes 16,000+ such integrations across 22 categories.

agent-web-scraper-mcp is one of hundreds of ai-ml entries indexed on Skiln. Browse the full ai-ml category or the complete directory of Claude skills, MCP servers, agents, commands, and hooks.

Related ai-ml MCPs and skills

  • agent-openapi-mcp by aparajithn

    Live OpenAPI runtime proxy that enables calling any REST API from MCP clients without writing wrapper code, by pointing at any OpenAPI spec URL.

  • agent-deploy-dashbaord by aparajithn

    Unified deployment dashboard MCP server for AI agents. 9 tools to manage services across Vercel, Render, Railway, and Fly.io — deploy status, logs, service listing, environment variables, rollback, and health checks from one endpoint. Free tier: 50 requests/IP/day.

  • agent-utils-mcp by aparajithn

    Swiss-army-knife utility MCP server for AI agents. 18 tools for JSON validation/formatting, base64 encode/decode, hash generation, UUID generation, URL parsing, regex testing, markdown↔HTML conversion, text stats, slug generation, datetime conversion, cron parsing, text diffing, CSV↔JSON conversion, and JWT decoding. Zero API Key required

  • Web Scraper by aparajithn

    Extracts clean text, structured data, and metadata from any website. Captures full-page screenshots to visualize web content. Performs Google searches to find relevant information across the web.

  • Developer Utilities by aparajithn

    Streamline technical workflows with a comprehensive suite of data transformation and validation utilities. Convert between diverse formats like JSON, CSV, and Markdown while managing encodings and identifiers efficiently. Enhance productivity by performing complex text analysis, regex testing, and timestamp conversions instantly.

  • Developer Utilities by aparajithn

    Simplify common data manipulation tasks like encoding, hashing, and formatting across various formats. Convert between CSV, JSON, Markdown, and HTML seamlessly to streamline data workflows. Extract insights from text and configurations through robust parsing, regex testing, and statistical analysis.

  • cloak-auth-bridge by inorilzy

    MCP server that bridges authenticated sessions from a Chrome extension to CloakBrowser profiles via local WebSocket, enabling agents to sync, verify, and debug persistent login state without exposing raw credentials.

  • express-cli by IH8E

    MCP server for the eXpress corporate messenger, enabling AI agents to list chats, search contacts, send messages, and wait for incoming messages with end-to-end encryption.

Frequently asked questions

How do I install agent-web-scraper-mcp?

Add the install command above to your Claude Code, Cursor, or Windsurf MCP configuration. Most servers register via npx, a local command, or a Docker image. Refer to the source repository for environment variables and credential requirements.

Which clients support agent-web-scraper-mcp?

Any MCP-compatible client works: Claude Desktop, Claude Code CLI, Cursor, Windsurf, Zed, and VS Code with the official MCP extension. OpenAI Codex and GitHub Copilot increasingly support MCP via adapter bridges.

Is agent-web-scraper-mcp free?

The server itself is typically open source. Any upstream service (API keys, paid tiers, hosted infrastructure) may have its own pricing. Check the source repository for details.