How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.
Free
One server, in web, search & scraping. How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.
Web, Search & Scraping
1
server published
1 category
—
installs
across every listing
0
followers
told when a release lands
1 of 1
tool-list graded
graded from the tools they list, not from code
1 MCP server. 1 of 1 is free to start.
Authentication
0 of 1 use OAuth
The rest either hold an API key issued by the publisher or ask for nothing.
Support
Community publisher
Listed without a verification tick. Read the listing before installing.