How It Works Ecosystem

The open directory of AI agents, LLMs, MCP servers, workflows, and tools — search, compare, and track status across platforms.

Explore

Browse All AI Agents LLMs MCP Servers Tools & Frameworks

Account

Sign In Create Account Submit an Agent Saved Agents

Support

How It Works FAQ Report an Issue

Company

ATMEZ AI Solutions

© 2026 ATMEZ AI Solutions · All rights reserved.

Built with ❤️ for the AI community

All Agents LLMs MCP Servers Workflows Frameworks Tools Skills GenAI News

Robotstxt Ai — AI Agent for mcp | Genaihub

Robotstxt Ai

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Live

Open / InstallLast updated September 3, 2026

Description

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.

Author

io.github.sharozdawa

Platform

mcp

Pricing model

free

Categories

mcp

Tags

No tags.

Capabilities

No capabilities listed.

Related agents

Others in the same category, ranked by how often they are opened.

DeepSite V4Generate any application by Vibe Coding itAgents · DevOps
Open LLM LeaderboardTrack, rank and evaluate open LLMs and chatbotsAgents · DevOps
AI Comic FactoryCreate your own AI comic with a single promptAgents · DevOps
Kolors Virtual Try OnA Hugging Face Space by Kwai-Kolors — built with gradio.Agents · Research
FLUX.1 [Dev]A Hugging Face Space by black-forest-labs — built with gradio.Agents · Research
MTEB LeaderboardEmbedding LeaderboardAgents · DevOps
DALL·E MiniA Hugging Face Space by dalle-mini — built with static.Agents · Productivity
IllusionDiffusionGenerate stunning high quality illusion artworkAgents · Research