TheCrawler
by io.github.manchittlab · Added 10h ago
Install
git clone https://github.com/manchittlab/TheCrawlerAbout
Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
Tags
ai-mlmcp-serverofficial-registry
by io.github.manchittlab · Added 10h ago
git clone https://github.com/manchittlab/TheCrawlerUniversal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.