Finds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo
Free
Scanned where there is a package or repository to read, and every release diffed against the tool surface we already hold.
Finds the robots.txt lines that reserve nothing — retired crawler tokens, shadowed groups, rules abo
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI
Names every WCAG 2.2 AA form failure on its line, with the criterion and the fix