Crawl History
This is from a long while ago, but still very much valid as a discussion point.
Data From Long Ago
So my Canadian Personal Finance site continues to be crawled by many different bots and such and it is making for some very interesting statistics.
What the heck is causing all this crawling around, I have no idea, but holy cow that is a lot of crawling that is for sure.