Overview
anthropic-ai is a crawler associated with Anthropic, used for AI model training, dataset discovery, and collection of public web content for model-development pipelines. It is commonly identified by the user-agent pattern .
Profile
- Operator
- Anthropic
- Classification
- Ai
- Verification
- Unverified
- Last verified
- Jun 23, 2026
- Common Use
- anthropic-ai is used for AI model training, dataset discovery, and collection of public web content for model-development pipelines.
- Company
- Anthropic
- Confidence
- Low
- Family
- Anthropic
- Identity Type
- observed
- Kind
- crawler
- Purpose
- ai-training
- Respects Robots
- unknown