Forum Moderators: martinibuster

Message Too Old, No Replies

You have ad crawler errors, which can result in lost revenue.

adsense crawler errors

         

PetroKal

2:43 pm on Jul 12, 2024 (gmt 0)

Top Contributors Of The Month



Good evening to the team,

How do I solve this problem?
[imgur.com...]

All I've done so far is go to Google Search Console Tools and under the "Removals" tab add the Link and wait for a response.

Should I do something else?

Thank you! <3

not2easy

3:12 pm on Jul 12, 2024 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Edited to add: I can't guess what link you removed using GSC, but if you want their ad bots to be able to crawl, you should look for how they are being blocked.

Have you tried clicking the "Fix" link in your AdSense user interface? Ideally you should be able to see the blocked crawl in your logs, but it would help to know what UA is being blocked so you could look into that. Do you use a CDN like Cloudflare?

[edited by: not2easy at 3:17 pm (utc) on Jul 12, 2024]

PetroKal

3:15 pm on Jul 12, 2024 (gmt 0)

Top Contributors Of The Month



Hello @not2easy and thank you again for reply.

If I click on "fix" it just throws me into it [imgur.com...]

PetroKal

3:17 pm on Jul 12, 2024 (gmt 0)

Top Contributors Of The Month



Also when click the issues : [imgur.com...]

not2easy

3:32 pm on Jul 12, 2024 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



All of those images say the same thing: the crawler is unable to reach the hosting server. The crawlers are being blocked and until you can fix that problem, they will not be serving ads.

PetroKal

3:39 pm on Jul 12, 2024 (gmt 0)

Top Contributors Of The Month



Yes, so the problem has to do with the server and the robot.txt file?
Thank you!

not2easy

3:53 pm on Jul 12, 2024 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



It may or may not be the robots.txt file. That is why I suggested to find the errors in your logs so you know for certain what UAs are blocked. That is also why I asked if you are using a CDN because services such as Cloudflare can be poorly set up (by the user or host) to block bots you want to have access for your site.

PetroKal

4:03 pm on Jul 12, 2024 (gmt 0)

Top Contributors Of The Month



Thank you very much! I'll have to ask my developer to tell me!

Delta3Girl

1:57 am on Nov 13, 2024 (gmt 0)

5+ Year Member



I am having a similar problem with crawler errors and restricted ad serving, but it's only happening on select posts. It's usually newer posts, but not always. Sometimes it is just a popular post.

Ads show up everywhere else - anchor, vignette, multiplex, other posts, archive header, etc.

The posts with the issue have spaces for the ads, but nothing there.

I'm not using a Cloudfare type thing. I have very good hosting.

This happened before and it eventually resolved, but in the meantime I'm losing money and no idea how to fix it.

Thank you if anyone has any ideas.