Crawl Readiness
Check whether AI crawlers can read a website, then fix what blocks them: llms.txt, robots.txt and JSON-LD generators, p…
Description
Check whether AI crawlers can read a website, then fix what blocks them: llms.txt, robots.txt and JSON-LD generators, plus LLM Monitor trends, from inside Claude, Cursor or any MCP client. Eight tools that call the live Crawl Readiness service. Four audit tools work without an account: score a site 0–100 against 50+ AI crawlers with a prioritized fix list, validate JSON-LD structured data, audit robots.txt line by line, and compare what people see with what AI crawlers receive. A free API key from crawlreadiness.com/dashboard unlocks three generators (llms.txt, an AI-crawler-aware robots.txt, JSON-LD schema) and a read-only view of your LLM Monitor trend: whether ChatGPT, Claude, Perplexity and Google AI mention your brand against competitors over time. Each tool sends the address you ask about, and the optional key, to www.crawlreadiness.com and nothing else. Docs: https://www.crawlreadiness.com/mcp · Source (MIT): https://github.com/Grubbomatic/crawl-readiness-mcp
Community Metrics
Author
grubbomatic
Platform
mcp
Pricing model
free
Categories
- mcp
Tags
- mcp
- smithery
Capabilities
- local