Overview
AdsTxtCrawler is a search crawler from OneTag Limited used for search indexing, URL discovery, page rendering, result freshness; it appears in server logs as .
Profile
- Operator
- OneTag Limited
- Classification
- Search
- Verification
- Unverified
- Last reviewed
- Aug 7, 2026
- Common Use
- AdsTxtCrawler is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Company
- OneTag Limited
- Confidence
- Medium
- Family
- OneTag Limited
- Identity Type
- observed
- Kind
- crawler
- Purpose
- indexing
- Respects Robots
- no