Forum Moderators: martinibuster

Message Too Old, No Replies

Huge Discrepancy Between My Logs And AdSense Reports

Is Google ripping me off? Is this happening to *You*?

         

Mister Markup

5:57 am on Jun 25, 2008 (gmt 0)

10+ Year Member



My AdSense revenue is way down lately. I thought this was just because my site is slipping in the SERPs a bit, so tonight I analyzed my log files for the first time in a long time, only to find a shocking result:

There is a huge difference between the number of page impressions that my AdSense Reports say I get, and what my web server log files say I'm getting. It's enough to amount to many hundreds of dollars per month in losses.

For May the difference was 33%, and so far this month the difference is a whopping 47%! That is, Google claims I'm only getting half the traffic that my web server says I am!

Now, this could happen if half my visitors used ad blockers or disabled javascript - but I find it hard to believe that so many would do so, or so suddenly. Also my site's demographic is not the sort to be sophisticated enough to know about ad blocking software.

I haven't analyzed further back than last month, but I certainly will. I'm afraid I let my site go on autopilot for too long because I got busy with other things.

I'll certainly contact AdSense support in hopes they can correct it, and maybe pay me for underreported clicks, but I'd like to know if any of you see this too, on your own websites.

Note that this is just the page impressions - nothing to do with channels, which often yield weird results.

For most of the time I've been in AdSense, the difference between their reports and my logs has been consistently very small.

leadegroot

8:19 am on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Probably a bot attack.

Mister Markup

8:29 am on Jun 25, 2008 (gmt 0)

10+ Year Member



If it was referrer spam, shouldn't I see it in my logs? Because I don't.

leadegroot

9:05 am on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No extraordinarily long visits from one IP?
No unusual agents?
Its surprisingly easy to miss a bot attack.
And sometimes the little buggers hide well and look like normal traffic until you look at the specific visits closely.
YMMV

zett

9:52 am on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



For once, I do not believe that Google is ripping you off using the method you mentioned. Main reason being - what benefit would Google have from this? (If they reduced CLICKS, that's a different story.)

Take scrapers, good and bad bots, and people with Adblockers and disabled Javascript, and you've got quite a group that retrieves a page but does not see ads. I would look for scrapers and bots, and no, I would not worry too much.

himalayaswater

10:22 am on Jun 25, 2008 (gmt 0)

10+ Year Member



Look for scrappers, bots and ripper softwares. Use firewall to limit connection per IP per minute. My analytical and adsense stats go together with +/0- 5%.

Staffa

11:37 am on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You might check your server logs for UA

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)

and read this thread :

[webmasterworld.com ]

StoutFiles

11:59 am on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'll certainly contact AdSense support in hopes they can correct it, and maybe pay me for underreported clicks

hahaha.

Even with the one in a million chance that Google is trying to cheat you out of money, they would never admit to it. Do not contact the Google Monster.

[edited by: StoutFiles at 12:00 pm (utc) on June 25, 2008]

zett

12:28 pm on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Do not contact the Google Monster.

Very good advice here. I absolutely second this: DO NOT CONTACT GOOGLE with this issue.

I think the ONLY reason to contact those overworked, underpaid people at The Plex is when the house is on fire. There's always the risk that you contact the wrong person, or the right person on the wrong day, and they see stuff they don't like on your site. Then your account may be at risk. Why take that risk?

HuskyPup

2:58 pm on Jun 25, 2008 (gmt 0)



There is a huge difference between the number of page impressions that my AdSense Reports say I get, and what my web server log files say I'm getting.

They are not the same animal!

Google Page Impressions are how many times AdSense have served a new set of ads and this does not happen every time someone uses your site/pages.

If AdSense is serving up the same ads it usually means there is a lack of ad inventory or possibly someone has paid to target your site. Possibly they are serving you the best paying ads they can do, this is something we never know.

Either way MY Google Page Impressions never agree with my own logs, I can kind of correlate them and I feel sure you will be able to once you have enough data.

And don't bother contacting them, their boilerplate responses will drive you crazy! :-(

andrewshim

3:23 pm on Jun 25, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Either way MY Google Page Impressions never agree with my own logs

Do they just quarrel with each other or do they get down and dirty with hand to hand combat?

<end off topic>

For what it's worth, my page impressions this month are on a roller coaster just like my earnings.

HuskyPup

3:32 pm on Jun 25, 2008 (gmt 0)



do they get down and dirty with hand to hand combat

Just like Christina Aguilera:-)

Mister Markup

1:12 am on Jun 26, 2008 (gmt 0)

10+ Year Member



You might check your server logs for UA

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)

Damn. That looks like what it is.

It doesn't account for the whole discrepancy, but in second place I see this:

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)

This difference is SV1 instead of 1813.

Is that also from AVG?

purplecape

2:31 am on Jun 26, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Very interesting. A whole world I was only vaguely aware of.

I'm curious about "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" too--it's #2 in my files as well.

andrewshim

3:57 am on Jun 26, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



MisterMarkup and purplecape...

You might check your server logs for UA
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)

Damn. That looks like what it is.

It doesn't account for the whole discrepancy, but in second place I see this:

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)

This difference is SV1 instead of 1813.

Is that also from AVG

I'm lost. For the benefit of non native techglish speaking people like me, can you please translate the last two posts? I just checked my logs and see those lines too.

netmeg

3:59 am on Jun 26, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



From the Microsoft Developer Network:

We’ve added "SV1" to the UA string so it’ll start looking something like this:

HTTP_USER_AGENT :Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 1.0.3705)

This will let site authors know that they’re being visited by someone who’s running an IE browser on the latest, most secure Microsoft platform. Right now only XPSP2 has this token, but soon you’ll see this token show up on other platforms as we bring our security enhancements to them.

SV1 stands for "Security Version 1" by the way. We’re proud of the security work that we’ve done in XPSP2 and wanted to be sure that site authors had some way to differentiate users running the latest version of IE.

Staffa

5:28 am on Jun 26, 2008 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



LinkScanner currently uses these user-agents:

Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)
User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1;1813)

For more, read the post I mentioned earlier in this thread.