85
/100
A
◉ Complete 4⁄4
robotstxt-ai-mcp
Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.
Anthropic
OpenAI
Perplexity
Web Crawler
Web Fetch
Complete visibility
— 4/4 applicable dimensions scored
✓ Schema Quality
○ Protocol
— Reliability
✓ Docs & Maintenance
✓ Security Hygiene
✓ Schema Interpretability
Schema Quality
76
25% weight
Protocol Compliance
—
20% weight
Reliability
—
20% weight
Docs & Maintenance
69
15% weight
Security Hygiene
95
20% weight
Schema Interpretability
98
15% weight
Score History
Category Trends
30-Day Uptime
30 days ago
Today
Static Analysis
| Metric | Score | Rating |
|---|---|---|
| Schema Completeness | 60 | Fair |
| Description Quality | 100 | Good |
| Documentation Coverage | 57 | Fair |
| Maintenance Pulse | 70 | Good |
| Dependency Health | 55 | Fair |
| License Clarity | 100 | Good |
| Version Hygiene | 80 | Good |
Analyzed 2 months ago