Google Analytics screens out googlebot visits!

Forum Moderators: open

Message Too Old, No Replies

Google Analytics screens out googlebot visits!

But I want to know when the gbot comes.

Mark_A

8:00 am on Jun 17, 2010 (gmt 0)

Anyone using google analytics? they seem fine for lots of things but for some reason I cannot see when googlebot visits though gbot should be a significant visitor, staying for a while and requesting a lot of pages, that should qualify gbot as appearing in the normal stats.

Anyhow it seems analytics (urchin) seems to screen out the Gbot, or is there any way I can see gbot activity in analytics?

leadegroot

8:54 am on Jun 17, 2010 (gmt 0)

Google Analytics is javascript based.
Bots, as a general rule, don't execute javascript, thus the Googlebot won't appear in your reports (nor will any other bots).

You will need server based reports to see your bot visits - if you are using unix hosting you probably have an install of awstats and that will let you see bot visits :)

Mark_A

9:42 am on Jun 17, 2010 (gmt 0)

Hi leadgroot, yes good point, analytics is indeed javascript based.

I guess for the moment I will have to rely on when my cached pages in google have been updated.

phranque

8:19 am on Jun 19, 2010 (gmt 0)

it's all in the server access logs.

TXGodzilla

12:54 am on Jul 19, 2010 (gmt 0)

You can get accurate reports of when GoogleBot visits your site by using Google Webmaster tools. You can also see if Gbot is having trouble crawling your site, which pages have been discovered and how many pages are crawled on each visit.