Can AI crawlers read your site?
Enter a website. We read its robots.txt and tell you which AI crawlers are let in, which are blocked, and what each block means for showing up in AI answers.
How to read the result
A bot obeys the group in robots.txt that names it, otherwise the * group, otherwise nothing applies and it is allowed. The longest matching rule wins; on a tie, Allow wins. If robots.txt is missing (a 404) every crawler is allowed. If we cannot read it at all, every crawler shows as "could not read" rather than "allowed".
robots.txt is one layer. A CDN or firewall setting can still refuse these crawlers when robots.txt allows them. If an allowed bot is still missing from the answers, check there next.