“Google” or “Something is crawling my site”
August 17, 2005 at 11:24 am
Most of you will be clueless about this, but by chance a few Web junkies read my blog, I’m going to throw it out there.
Just checked my Web stats and it looks like my site is getting crawled by the Google bot. Click on the picture for a detailed view of a recent site visitor.
In layman terms, "crawling" is how Google keeps tabs on the Web. Every month or so, its systems index the billions of Web pages that make up the Internet. It does this, for the most part, by visiting each Web page and clicking on all the links of each Web page and following them where ever they go. Obviously, this isn’t done manually, by humans, but by "bots." Software, basically.
I did a paper on how Google works for the lone graduate course I’ve taken. Maybe I’ll post that and really put you all to sleep.