RobotsGate
Generate and validate robots.txt rules for AI crawlers, check which AI bots a live site allows, and look up a sourced A…
Live
Open / InstallLast updated October 8, 2026
Description
Generate and validate robots.txt rules for AI crawlers, check which AI bots a live site allows, and look up a sourced AI crawler registry. Free: 20 checks and 60 generate/validate calls per minute; Pro $9/mo. RobotsGate is not affiliated with Meta or any other crawler or agent operator.
Community Metrics
Views
0
Avg Rating
N/A
Ratings
0
Likes
0
Comments
—
Author
mike-tusa
Platform
mcp
Pricing model
free
Categories
- mcp
Tags
- mcp
- smithery
Capabilities
- Remote MCP server
Information
TypeMCP Server
SourceSmithery
AddedOctober 8, 2026