How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.
Free
1 MCP server
By onlinewebdirectory
Scanned where there is a package or repository to read, and every release diffed against the tool surface we already hold.
How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.