WE
Robots-aware website audits, pre-crawl quotes, and structured evidence for people and agents.
WE
Website to Markdown — Bounded Crawls for Agents MCP Server
Published by kriton-devCrawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
- CATEGORY
- Browser & web
- DEPLOYMENT
- Remote endpoint
- LATEST SOURCE VERSION
- 1.0.2
- SOURCE CHECKED
- Oct 31, 2026