TheCrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Ready: LocalSecurity: LocalAuth: UnknownSetup: Unknownmcp_servermcp

Use it

Packages
  • npm: thecrawler 0.5.8npx -y thecrawler
Instructions
  • Use an MCP client, but no callable endpoint or package install target was published.

Version history

VersionStatusPublished
0.5.8LatestactiveJul 2, 2026
0.5.7LatestactiveJun 29, 2026
0.5.4LatestactiveJun 26, 2026
0.5.3activeJun 26, 2026
0.1.1activeApr 18, 2026