Forum Moderators: martinibuster
The reason for this separation is because the basic data available can be viewed in a number of helpful reports and views that users find valuable. But these multiple views cause duplicate problems for my site with Google. I do not want to only show ads on the pages accesses by Google bot as my analysis of visitor activity shows that most of my ad clicks come from these various views.
My logs show that the bots are accessing the pages as I have indicated (Google bot only accesses limited pages via a single URL and Mediapartners-Google/2.1 accesses all pages on my site). However, I have massive supplemental pages because Google bot has only been restricted for a couple of months, since I've learned of the duplicate page impact on my site.
My question is,
1. Is allowing Mediapartners-Google/2.1 full access to my site exacerbating the duplicate page issue on my site? And
2. If it is does anyone have a suggestion on how to control the duplicate page issue while allowing Mediapartners-Google/2.1 access to provide targeted ads?
Thanks in advance for you help.
Anyway, read here:
for a robots.txt based solution