Page 1 of 1

Google Bot user?

Posted: Mon Jun 18, 2007 2:19 pm
by [JiF]Sly Gambit
Just saw this:
Who is online
In total there are 5 users online :: 2 registered, 0 hidden and 3 guests (This data is based on users active over the past 5 minutes)
Most users ever online was 20 on Tue Oct 10, 2006 10:49 pm

Registered users: [JiF]Sly Gambit, Google [Bot]
Legend: Administrators, Global moderators

Re: Google Bot user?

Posted: Mon Jun 18, 2007 2:33 pm
by [JiF][AARP]Jimbo
Yes all the Search Engine Bots have usernames now and that one never seems to go away. You will also see ask jeeves, yahoo and msn bots from time to time.

Re: Google Bot user?

Posted: Mon Jun 18, 2007 3:21 pm
by [JiF]Sly Gambit
[JiF]Jimbo wrote:Yes all the Search Engine Bots have usernames now and that one never seems to go away. You will also see ask jeeves, yahoo and msn bots from time to time.
If you want to I believe you can get rid of the 'honest' bots:

http://www.google.com/support/webmaster ... swer=35302

There's a robots.txt file you can put in your web server instances root domain. We've done that at work. Someone managed to find a test site and even though it said TEST and QA all over they still put in something they meant to put in our production site. So now we exclude everything and the major search engines all seem to be behaving.