Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 16,271,695 user agents and growing


MAR 24

2007

March Bot Madness



The last couple of weeks have brought us over 20 bots and a few other points of interest. Here they are:
  • If you see contype in your user agent logs, this is not a bot. Microsoft has published a knowledgebase article about this problem - in a nutshell, older versions of IE (4 to 5.5) send multiple requests to retrieve an unknown plugin. One of the multiple requests uses the user agent "contype" to request just the content-type from the server. Click here to find out more. related...
  • In other news, Quantcastbot/1.0 visited us this week. Quantcast provides ratings and demographic information to web sites for free. related...
  • A new version of Blaiz-Bee visited us - Blaiz-Bee/2.00.8315. This particular version crawls for a search engine made entirely of Windows 98 servers using sub-standard hardware. It's good to know that all those licenses of 10-year old Windows have a home and can feel useful. related...

We now have 65,484 user agents and 898 bots.

Blog Archives:












APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (349)
  • SQL Injection (7,701)
  • PHP Injection (1,993)
  • XSS Attacks (66)
  • Link Injection (250,869)