Web, Search & Scraping MCP Servers

ACAO star-or-origin, value discarded

Six paid URL-intelligence tools for autonomous agents and agent swarms.

Cloudflare Workers MCP server: ai-crawler-policy

Web data tools: Threads, Yelp, YouTube/TikTok transcripts, Google Trends, Airbnb, Jumia prices.

Real-time news search across 500,000+ sources in 60+ languages with sentiment and entities.

BCP 47 lang attribute shape

One MCP server over 253 data sources: Reddit, LinkedIn, YouTube, G2, search and AI answers.

Bing Chinese search MCP server.

Search and read public Black Label Operator pages with source URLs.

Public Telegram channel posts, views, reactions, media and subscriber counts. No login needed.

Bright Data MCP — Bright Data Web Unlocker + SERP API (brightdata.com)

Validate up to 75,000 URLs per job (status, redirects, response times). OAuth 2.1.

YouTube transcripts, search, channel/playlist listings and upload tracking for AI agents.

Verified business OSS MCP for search, RSS, crawling, documents, browser, media and transcription.

Real-time Claude & Anthropic news from your own Claude — free, no API key.

Cloud Api Hub - Youtube Downloader: Get Youtube video info and download links to MP4 or MP3 file.

Compact, citation-verifiable public web context for AI agents, paid per use with x402.

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?

Web access for agents: fetch, extract, screenshot, or PDF any public URL.

Connect custom domains via AI agents: DNS pre-flight checks, hand-off connect sessions and checks.

Domain enrichment: email provider, DMARC/SPF/DKIM, WHOIS age, SSL, hosting and CDN per domain.