Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Free
Scanned where there is a package or repository to read, and every release diffed against the tool surface we already hold.
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.