The last month was very exciting, since we broke 200,000 user agents!
It was almost exactly a year ago that we broke 100,000 user agents, and almost 2 years since we broke 50,000 user agents
How the time flies by.
Here are some bots that seemed interesting to us this month as we head further into September:
The Internet Ninja 6.0 leads off the list for this month of new bots.
However, a good Ninja would visit a web site and not leave footprints behind in the weblogs.
This bot has some of the best movie references - they managed to squeeze "Terminator" and "2001 : Space Odyssey" references into one user agent:
HAL 9000; Cyberdyn X3; T1000 autonomous
Another new bot, CydralSpider/3.0, crawls for a "Visual Search Engine" named Cydral.
The ShrinkTheWeb.com Crawler v1.0
bot crawls pages on the web to produce a thumbnail of each page.
According to their site, "ShrinkTheWeb is the most powerful, free website thumbnail provider".
In the fine print, they allow up to 250,000 free thumbnails per month for free, and pay services extend beyond that.
We had 2 toasters drop in - the first one,
WebToaster V0.9 Alpha,
was nice enough, but the second one attempted HTML injection on our site to hijack a free link:
</a><a href='http://www.webtoaster.com'>WebToaster</a> - WebToaster V0.9 Alpha.
Shame, shame, we know your name, and now everyone that reads our site does too.
Nutch made a big splash in our logs this month with quite a few new user agent variations: related...
We also got some new curls this month - Perl interface for libCURL,
Here's the rundown on some other interesting bots that dropped in over the last month:
We are now at 200,000
user agents and 2,194