Back to Bots
Verified

Scrapy

Directory statusActive
Last updatedSep 20, 2026

Overview

Scrapy is a web scraper used for public web data collection, page extraction, content monitoring; it appears in server logs as .

Profile

Operator
Scrapy
Classification
Scraper
Verification
Verified
Last verified
Jun 22, 2026
Common Use
Scrapy is used for public web data collection, page extraction, content monitoring, and third-party crawler activity.
Company
Scrapy
Confidence
High
Family
Scrapy
Identity Type
official-documented
Kind
crawler
Purpose
web scraping
Respects Robots
unknown