Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 16,268,829 user agents and growing


JUL 22

2007

Hot Summer Bots



The bots continue to roll in this summer, so here's a catch-up on the last few weeks:
  • Spock Crawler visited us on it's "mission to index every single human being on the planet" (no, seriously - this was taken straight from their website). Whatever their service is, it is invitation only for now. related...
  • Pete-Spider/1.1 is a new spider that dropped in, and the top google results for this user agent point to our site. Since we have no idea what this spider does, it appears nobody does. related...
  • Another new bot, ilial/Nutch-0.9 dropped in, containing a Nutch-0.9 engine and owned by "Ilial, Inc. is a Los Angeles based Internet startup company." According to their site, ilial is a new search engine built from venture capital that has technology to redefine the online advertising industry. related...
  • Don't forget our new iPhone category - it now has a grand total of 17 user agents. If you have an iPhone, please visit our site so we can capture the user agent and add it to the list. related...
This leaves us at 86,589 total user agents in the database, and 1,102 are bots.

Blog Archives:












APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (349)
  • SQL Injection (7,701)
  • PHP Injection (1,993)
  • XSS Attacks (66)
  • Link Injection (250,869)