AC
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.
mcpb · https://github.com/Mingye-Lu/AgenticCrawler/releases/download/v0.17.0/acrawl-mcp-linux-x64.mcpb