Online Web Directory
How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.
Live
Open / InstallLast updated October 23, 2026
Description
How websites treat AI agents: bot walls, JS needs, robots rules, llms.txt. Look up before you fetch.
Community Metrics
Views
0
Avg Rating
N/A
Ratings
0
Likes
0
Comments
—
Author
net.onlinewebdirectory
Platform
mcp
Pricing model
free
Categories
- mcp
Tags
No tags.
Capabilities
- official
- remote
Information
TypeAgent
SourceMCP Registry
AddedOctober 18, 2026