SC

Scrape-LE MCP

Analyse robots.txt content and report whether a path may be crawled.

Grade A Local · stdio No auth needed 1 tool v2.4.0 · 7 Oct 2026
No reviews yet by nolindnaidoonpm 1,982 Runs on your machine, nothing hosted
99/100
trust score
7
downloads a day
local
runs on your machine
1k
downloads in 30d

What it does

Analyse robots.txt content and report whether a path may be crawled.

Quickstart

# 1 — add it to Claude Code claude mcp add --scope user scrape-le-mcp '--' npx -y scrape-le-mcp # 2 — ask your agent for something these tools do # analyze_robots_txt

Scrape-LE costs nothing on mcprush: there is no plan to choose here, no cap to set and nothing mcprush can bill you for.

Publisher
NO
nolindnaidoo18 servers
5 categories
All 18 servers
More in this category

See also

See all