Bots vs Browsers - Public Bot / User Agent Database & Commentary

Bots vs Browsers - database of 16,271,487 user agents and growing


JUL 6

2008

Dog Days of Summer Bots



We had quite a few new faces in the logs last week, from established sites like Yahoo! all the way to some new startup search engines that are sending their bots out into the wild to harvest searchable content. Here's the high points of our week:
  • Yahoo! has a new YahooSeeker-Testing/v3.9 bot that dropped in for a visit. related...
  • TheRarestParser/0.4b is a new version sent from TheRarestBlog. This bot crawls web pages to find the rarest words used on the web. related...
  • Watch out Google - here's two startup search companies that are crawling the web -
    OOZBOT/0.17 from Setooz - their site is currently "Under Construction", but a search engine will likely appear there someday. related...

    Zook.in looks like a startup that sent their Knight/0.2 bot by for a visit. From visiting their site, it looks like they aren't quite ready for prime time yet since there isn't really a site there yet. related...
  • Slurpem Search sent a bot informing us that they are "Sucken Up The Web". I hope Slurpem is thirsty, because there's alot of web out there to suck up. related...
  • Firebat 2.7.13 is a new bot on our site as well. Firebat does not have a good reputation on the web from what our research has turned up. They are mentioned in many places with large denial of service attacks and several other shady activities. related...
  • EmailWolf 1.00 prowled our sites looking for emails to chew on, but we don't post emails, so the email wolf went hungry. related...
  • Someone or something at IP 84.0.233.218 was kind enough to attempt a script injection to call a javascript alert telling the calling browser of XSS (Cross Site Scripting) vulnerabilities on the site. Of course, we are not vulnerable to XSS, but nice try. This puts us at 75 unique script injection attempts. Make sure when you are viewing your web stats that you do not allow scripts to be executed from the user agent, or they could easily snipe your cookie and hack your web stats portal. related...
We're heading into the second week in July now at 185,694 user agents and 1,993 bots - thanks for visiting!

Blog Archives:












APR 18

2009

Where did Palm go?







JUL 13

2008

2,000 bots!





JUN 19

2008

And we're back...


JAN 21

2008

Happy 2nd Birthday!


OCT 25

2007

The Creature Post



JUL 22

2007

Hot Summer Bots




JUN 13

2007

Twiceler Strikes!


JUN 3

2007

Land of 1,000 bots




MAR 24

2007

March Bot Madness


MAR 10

2007

Got Spiders?




FEB 3

2007

February Stars


JAN 12

2007

Happy 1st Birthday!




DEC 12

2006

50,000 User Agents!



OCT 17

2006

2 weeks, 30 bots


OCT 2

2006

4 weeks, 23 bots



AUG 26

2006

500 bots!


AUG 20

2006

5 days, 8 bots











MAY 2

2006

A few new bots









JAN 12

2006

Day One


USER AGENT CATEGORIES

BOTS
BROWSERS
MOBILE BROWSERS
OLD SCHOOL
OTHER
SPAM / HACKS
  • Script Injections (349)
  • SQL Injection (7,701)
  • PHP Injection (1,993)
  • XSS Attacks (66)
  • Link Injection (250,869)