Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 16,273,349 user agents and growing


JAN 15

2013

7 Years Old, One Million User Agents!



Wow - 7 years old. What started out as a goofy idea of narrating user agents in our web traffic logs has grown so much in 7 years. Not to mention that four our seventh birthday, we found our one-millionth user agent to put us into seven-digits! We are now sitting at over 1 million user agents, of which 20,000+ are identified as bots.

The most notable change in the last seven years has to be the nature of devices that we see from our sites and contributing sites. In the early days, most user agents were either Internet Explorer, Netscape, Opera, or some form of Mozilla, and everything else was pretty much bots or proxies. Now looking over our categories, mobile and non-PC user agents seem to be the most diverse and rapid changing. In our first two or three years we never saw advertising, spamming, or script injection attempts in user agents. Since the Script Injections category appeared, it has grown rapidly, and the number of user agents containing spam has also been a challenge to weed out from useful data.

We've come a long way from the days where we just wanted to know if you were Netscape Gold 3 or Netscape Navigator 4, and if your browser was capable of handling that new-fangled concept of client-side JavaScript. As always, thanks to our site contributors who take the time to send us their data to mine through, and to our readers - we hope that you continue to find our site useful in the coming years!

Over the next few weeks and months, we'll focus on posting about different areas that have changed in the User Agents realm over the past few years. Look for posts to focus on different user agents from phones, tablet and touch enabled devices, gaming consoles, and last but not least, bots!

At seven years of operation, we now have 1,000,047 user agents and 20,014 bots tracked to date!

Blog Archives:












APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (349)
  • SQL Injection (7,701)
  • PHP Injection (1,993)
  • XSS Attacks (66)
  • Link Injection (250,869)