Checks if GPTBot, ClaudeBot, PerplexityBot, Googlebot and 9 more AI crawlers can reach a page.
Browser & web MCP servers
Browse 1,534 browser & web MCP servers. Explore, extract, and interact with the web.
Visible Electron browser driven by a semantic accessibility tree: 17 MCP tools, no screenshots.
Check if AI crawlers like GPTBot and ClaudeBot can reach, index and quote any web page.
Can ChatGPT, Claude and Perplexity crawlers reach a site? Real per-bot fetch, firewall/CDN blocks.
Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.
Check declared robots.txt permissions for six AI crawlers at URL paths
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
Check a site's robots.txt rules for AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more).
Cloudflare Workers MCP server: ai-crawler-policy
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents.
Let an AI agent drive a 2D robot rover simulator in the browser: sensors, camera, wiring and code.
Audits AI-crawler access, structured data and llms.txt on a site, and drafts the fixes.
AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.
Free live checks: AI crawler access, llms.txt, entity schema and AI-search readiness of any site.
One-call audit: robots.txt AI-bot rules, llms.txt, JSON-LD, meta tags, sitemap. Score plus fixes.
AI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.
Turn any website into structured JSON data matching your custom schema.
Read public webpages, extract structured data, discover links, and run bounded crawls.
AI browser agent: browses, clicks, types, and reads real web pages from plain-English instructions.
AI-powered browser automation MCP — 6 tools for web interaction, extraction, and validation.
Browser-based QA for AI-built software. Test pages with real browsers via agents.
Collective intelligence for browser automation agents. Site capabilities, selectors, and extraction.
Public Airbnb listings by destination or URL, with calendar availability and prices.
Share what you're building.
Discover what works. Build what’s next.