Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 16,271,524 user agents and growing


OCT 25

2007

The Creature Post




After looking at the types of bots we've had drop in lately, plus keeping with the halloween spirit, we figured it was time we had a "Creature" post.
  • To start of the creatures, we were visited by a squid / clam - no kidding: SquidClamAV_Redirector 1.8.2. This seems to be some sort of proxy / redirector bot. Not sure what redirecting has to do with squids or clams, but the idea is interesting. related...
  • Next up, we have the dreadful Yeti/0.01, a creature so fierce that they even have a ride at Disney devoted to it. As fierce as the Yeti may be, the user agent string does kindly inform you that it does "check robots.txt daily and follow it". related...
  • genieBot paid us a visit, but did not offer us three wishes - just a contact email for the bot. Bummer. related...
  • Okay, so this one may be a stretch, but CookieMonster is still a creature, right? Maybe we should save this one for a Sesame Street post. We are calling this one a bot until we see otherwise. related...
  • To round off the list, we have a classic bot that hits us quite a bit, but in a slightly different form this time - you guessed it, Python-urllib/1.17 related...

Happy halloween everyone - this brings our site to 110,099 user agents and 1,293 bots.

Blog Archives:












APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (349)
  • SQL Injection (7,701)
  • PHP Injection (1,993)
  • XSS Attacks (66)
  • Link Injection (250,869)