Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 16,270,827 user agents and growing


JUL 4

2006

New category, bot revisions, and 6 new bots for July 4th



  • Yahoo Mindset came by for the first time. This bot helps power the Yahoo! Mindset search engine, which provides intent-driven searching. Yahoo! has this project categorized as "Research", so I assume it is still in the hangar.   related...
  • The WebarooBot hopped in to make it's debut on our site   related...
  • Also new is NetSprint -- 2.0 - this appears to be a bot that crawls for the Polish search engine "NetSprint.pl"   related...
  • The ActiveTouristBot V1.2 toured on over to our site this week   related...
  • A new version of CFNetwork/129.16 came to our site, most likely in the form of a bot, since this is a Mac API   related...
  • Our weekly new-version of FindLinks dropped by also. They appear to have broken the 1.1.3 version now, but it says it's still in beta, so watch out. These guys must be performing rapid development (or rapid repairs) on their bot since it's version seems to increment every other week   related...
  • In looking over the site, I noticed that the Bots category was getting junked up with user agents that had been reported as bots, but were unsubstantiated by any other sources. To clean the site up a bit, I moved all of these user agents to a new category called Unidentified.
These user agents bring us to 38,945 user agents and 416 bots

Blog Archives:












APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (349)
  • SQL Injection (7,701)
  • PHP Injection (1,993)
  • XSS Attacks (66)
  • Link Injection (250,869)