Overview
Cloudflare Robots API is a verified Cloudflare fetcher that retrieves robots.txt files for AI Crawl Control. It identifies itself as .
Profile
- Operator
- Cloudflare
- Classification
- Monitoring
- Verification
- Unverified
- Last reviewed
- Aug 7, 2026
- Common Use
- Retrieves robots.txt files for Cloudflare AI Crawl Control to evaluate crawler directives.
- Company
- Cloudflare
- Confidence
- High
- Family
- Cloudflare
- Identity Type
- http-message-signature
- Kind
- fetcher
- Purpose
- monitoring
- Respects Robots
- depends