Bots vs Browsers - database of 16,267,900 user agents and growing
User Agent Details for "Scrapy/0.24.4 (+http://scrapy.org)"
User Agent Vitals:
User Agent:
Scrapy/0.24.4 (+http://scrapy.org)
Bot or Browser:
This User Agent
is
a known bot.
First Seen On:
8/21/2014 11:50:00 PM
URL:
http://scrapy.org