Web, Search & Scraping MCP Servers for Claude Code

Finds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo

MCP server for information retrieval with web search, web crawling, and image search capabilities

Read-only MCP server giving AI agents the web as compact, ranked, verified evidence. Local cross-encoder reranker, NLI claim verification

No-KYC web search for AI agents, paid per query in Lightning sats (L402). Holds no keys.

MCP server for fetching URLs, safe against SSRF, DNS rebinding, and redirect-to-internal attacks.

Scrapingdog web-scraping & SERP APIs: web scrape, Google, Amazon, LinkedIn, YouTube, and more.

YouTube transcripts for AI agents: videos, channels, playlists, search. Timestamps, SRT, VTT.

MCP server for kimi search integration

Search websites by source code, technology stack, analyze domains, and download lead lists.

MCP server and client for web search and page viewing tools - DuckDuckGo search and web scraping

MCP server for ThatMgmt: domain availability, quotes, registration prep. Crypto checkout.

AI-powered web scraping MCP. Distill pages to Markdown or extract structured data via JSON Schema.

MCP server for CrustAPI. Lets AI agents pull live Google data (Search, Maps, News, Shopping, Images, Videos, Reviews, Scholar, Patents

Turn any URL plus a schema into validated, typed JSON via the Extracto API.

Unofficial MCP server that utilizes your Perplexity Pro subscription for AI queries with web search

Open-source MCP server for AI agents: web search, content extraction, and library docs.

Check a site before you share it: link previews, SPA refresh 404s, noindex, security headers.

Yellow Pages local business search and full business listings, as structured JSON.

Extract structured data from a web page, read it as markdown, verify values against the source.

Read your AI-written daily briefing and retune the filter behind it: feeds, newsletters, topics.

smart-data-extractor MCP server on Cloudflare Workers · REST + MCP JSON-RPC · free tier