Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 1,554,307 user agents and growing


MAY 19

2006

A couple new sightings



Another quiet week for new bots again - here are the high points for the week:
  • Oracle's search bot Oracle Ultra Search dropped in to index some content. The Oracle Ultra Search user agent is apparently a means for Oracle databases to index content for storage in Oracle Ultra Search systems.   related...
  • A never-before seen (on our site) version of FindLinks appeared in our server logs   related...
  • As an experiment, we put out a "test track" on the site for trying out user agents. This area of the site allows you to test drive user agents and simulate the output of sites by choosing a user agent, and a destination URL to try out. This can be useful to see how sites may behave differently to a bot visitor vs how they behave to a human.

    FYI - the practice of masking content to display differently to a browser than a bot is commonly referred to as "cloaking" and is generally frowned upon by search engines and SEO experts.
We are now sitting on 35,343 total user agents and 424 bots in our database

Blog Archives:


FEB 29

2016

Leap Day Launch!











APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (298)
  • SQL Injection (7,697)
  • PHP Injection (1,435)
  • XSS Attacks (58)
  • Link Injection (250,860)