Overview
Semantic Scholar Bot is a search crawler from Allen Institute for AI used for search indexing, URL discovery, page rendering, result freshness; it appears in server logs as .
Profile
- Operator
- Allen Institute for AI
- Classification
- Search
- Verification
- Verified
- Last verified
- Jun 2, 2026
- Common Use
- Semantic Scholar Bot is used for search indexing, URL discovery, page rendering, result freshness, and search-quality checks.
- Company
- Semantic Scholar
- Confidence
- High
- Family
- Semantic Scholar
- Identity Type
- official-documented
- Kind
- crawler
- Purpose
- academic search crawling
- Respects Robots
- yes