webclaw
by 0xMassi · Added 26d ago
23
Install
git clone https://github.com/0xMassi/webclawAbout
webclaw is the fastest web scraper for AI agents, extracting clean, structured content from any URL with Chrome-level TLS fingerprinting and optimized output for LLMs. It supports multiple tools for AI agents and can be configured via environment variables such as WEBCLAW_API_KEY for cloud API key and OLLAMA_HOST for local LLM features.
Tags
browser-webmcp-serverwebscrapingaiagentsmcpservercontentextractionllmoptimizationcrawlerapi