AIAI Crawler Permission CheckCheck a site's robots.txt rules for AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more).Browser & webRemoteMCP Registry
AIai crawler readinessCan AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain indexBrowser & webRemoteMCP Registry