Access
Weight 40%
- Homepage responds, without redirecting to another site or to HTTP
- robots.txt rules for search crawlers, including OAI-SearchBot, Claude-SearchBot, PerplexityBot, Googlebot, Bingbot and Applebot, and for user-triggered AI fetchers
- AI training opt-outs, reported but never scored
- Indexing and snippet controls in headers and HTML
- CDN or WAF challenge page detected
- Optional llms.txt file, reported with zero weight