Web, Search & Scraping MCP Servers for HTTP / API

Redirect hop count band 0-5

Check, register and manage .gy (Guyana) domains, and connect AI-built websites with preview + undo.

Web MCP: scrape/crawl sites, web search, brand assets, app stores, YouTube, Reddit, Hacker News.

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

robots.txt group count

RSS/Atom link rel count, markup discarded

Read RSS, Atom and JSON feeds, or find the feed of any website, with filters and only-new mode

Search bounded RSS, Atom, and RDF feed matches by keyword or regex.

Extract and structure pricing pages from any SaaS site: plans, tiers, and features.

GET a public URL now and report whether an exact needle is still in the body.

AI news API: duplicate AI-industry headlines collapse into one structured event.

Suggest domain names, rank them, confirm availability at the registry, hand over a buy link.

ScrapeCreators MCP — wraps the ScrapeCreators social-media + ad-library

Web search, scraping, RAG answers with citations, and translation as MCP tools.

One API for public web data across social, directories and real estate, as clean JSON.

ScraperAPI MCP — wraps ScraperAPI (scraperapi.com), a proxy-based web

Fetch any page's HTML or AI-parsed JSON, Google results, or 100+ site plugins via ScrapeUnblocker

Cloud-based web access with real browsers and JS rendering by ScrapingAnt

ScrapingBee MCP — wraps the ScrapingBee headless-scraping API (scrapingbee.com)

Any URL to clean text, markdown, or JSON for LLM/RAG pipelines.

Route web, social, and filings data tasks to the best available scraper.