PO

Polite Crawler MCP

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

Grade A Local · stdio No auth needed 4 tools v0.1.0
No reviews yet by mark1russell7npm Runs on your machine, nothing hosted
96/100
trust score
4
tools declared
local
runs on your machine
—
downloads a day

What it does

A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.

Quickstart

# 1 — add it to Claude Code claude mcp add --scope user polite-crawler-mcp '--' npx -y polite-crawler mcp # 2 — ask your agent for something these tools do # crawl_fetch, crawl_find, crawl_read and 1 more

Polite Crawler costs nothing on mcprush: there is no plan to choose here, no cap to set and nothing mcprush can bill you for.

Publishernot claimed
MA
mark1russell71 server
1 category
All 1 server

Collected from a public index. Nobody has claimed this account, so nothing here was written by its author — claim it if it is yours.

More in this category

See also

See all