Overview
Cloudflare Web Scanner checks liveness, content types, robots.txt directives, and related web properties; it appears in server logs as .
Profile
- Operator
- Cloudflare
- Classification
- Scanner
- Verification
- Unverified
- Last reviewed
- Aug 7, 2026
- Common Use
- Checks liveness, content types, robots.txt directives, and related web properties.
- Company
- Cloudflare
- Confidence
- High
- Family
- Cloudflare
- Identity Type
- observed
- Kind
- crawler
- Purpose
- web-property-scanning
- Respects Robots
- unknown