Discovered · unverified

crw

Web search and web scraping for AI agents in one fast, single-binary MCP server. crw searches the web, scrapes any URL to clean markdown or HTML, maps a site's links, runs bounded recursive crawls, and extracts structured JSON from pages. Built-in anti-bot handling, JavaScript rendering, and proxy rotation recover content that a plain fetch and lighter scrapers miss. Open source (AGPL), local-first, and zero-config via npx, or use this managed cloud endpoint. A leaner, self-hostable alternative to Firecrawl and Tavily for agent web access, docs research, and structured data extraction.

Source-provided description, not an independently verified capability claim.

Check the source before connecting.

Vendor ownership, pricing, documentation, and execution are not verified for this discovery record. Appearing in the official MCP registry does not mean this server is vendor-owned or tested.

Relevance and review status.

Awaiting triage. Method: not yet classified.

Task signals: web scraping, web search.

Setup and documentation.

No verified installation steps or callable endpoint are supplied by this discovery record. Follow the original repository or directory entry to inspect current setup instructions, permissions, and authentication.

Source receipts.

smithery · Observed 2026-10-17

Discovery ID: 857d274ddf3ba807d72a. Snapshot: 2026-10-17. Read this record as JSON · Full discovery dataset.

Submit primary documentation for review · Connect your agent to GTMMCPs