Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Four old domains axed (thrown out of index)

         

night707

6:53 pm on May 25, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



4 from 8 old domains can no longer found on Google since a few weeks,

Dns records for all 12 domains are in a perfect standing. Checked multiple times by web host, registrar and various tools including those from Google.

WMT can read sitemap, confirms connectivity, robots txt but flags dns error ....

Any suggestions fellows .... after weeks of checking i am clueless ....

.

Andy Langton

9:01 pm on May 25, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Seems a bit mysterious - but why not just change DNS? This could just be a temporary measure - you could pay for DNS hosting (which is inexpensive) or use a service like Cloudflare who demand you change to them.

Otherwise, troubleshooting DNS can become a little involved. Is there any more info from Google? Do you know if it is a problem contacting your name servers or with retrieving the relevant records?

robzilla

9:09 pm on May 25, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You can check that the records are OK, but what about the servers? Take the errors seriously and set up different (or secondary) nameservers. I use Route53 myself but there are plenty of free and reliable hosted DNS services as well. Also consider a DNS monitoring service.

night707

9:47 pm on May 25, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Thanks a lot lads, but why changing the infrastructure when 4 domains are doing fine since ages with exactly the very same settings ... ? Any idea on how to contact Google apart from posting at their useless forums?

Andy Langton

10:12 pm on May 25, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Trying to fix it yourself will, at the very least, be quicker than getting Google to fix it. It's also a way to prove that it's a problem with them, which increases your chances of a permanent fix.

robzilla

6:43 am on May 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Like I said, the DNS settings may be fine, but there may be an issue with the nameservers not (properly) responding to queries. Apparently, Google has trouble fetching your DNS records, so the first thing I would have done is set up DNS monitoring and probably change the nameservers. Google can't solve it if the problem is on your end.

night707

7:36 am on May 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



robzilla, every #*$! dns tool that you can find on the web including googleapps confirmes, that all dns entries are fine.

And WMT can even reach these domains as robots text and server connectivity are confirmed to be ok.

Also several other domains on the same server with exactly the very same settings show none of such issues.

.

robzilla

10:28 am on May 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Still doesn't mean the problem can't be with your nameservers. Change them and you'll know.

Are the DNS errors dated? Are they still occurring? Is the type of error specified?

night707

3:21 pm on May 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



What could be possibly be wrong with the nameservers when Google has no issues with 8 domains and calls 4 temporarily unavailable though connectivity and robots txt are fine for all 12?

Neither web host nor registry seem to have any clues after checking all dns records thoroughly ....

lucy24

3:39 pm on May 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Well, ###, I thought there was going to be a pervasive google/DNS problem because a near-identical issue came up less than a week ago:
[webmasterworld.com...]
But it's the same person asking. Are the same sites involved? What's the difference between that thread and this one?

night707

5:06 pm on May 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Things have gone worse Lucy, so i started a new thread seeking solutions. Meanwhile those 4 domains can no longer be found on Google.

Everyone seems clueless, from web host to registrar. No response from Google and nothing on their product forum.

robzilla

6:17 pm on May 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Or you did not get the answers you were hoping for. Google is not going to fix your DNS errors, and if you don't try a change of nameservers (5 minutes work?) or answer my questions, I can't help you.

Shai

6:42 pm on May 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Just because your online tools are not reporting any problems now does not mean there were no problems when Google tried to resolve your domain name. Im presuming this is some sort of a shared hosting package?

tangor

7:08 pm on May 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Are these domains or subdomains?

night707

8:29 pm on May 26, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Why changing nameservers that were doing fine since years for these real domains when all of a sudden WMT flags 4/12 for DNS errors? All 12 have the same records.
Google reads all 12 robots.txt well and confirms server connectivity.

Bing has no problems at all ?

3zero

8:32 pm on May 26, 2016 (gmt 0)



Are these domains or subdomains?


Great question also do you have a wildcard *.domain.com in your dns records?

robzilla

9:36 pm on May 26, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Open questions:
Is there any more info from Google? Do you know if it is a problem contacting your name servers or with retrieving the relevant records?

Are the DNS errors dated? Are they still occurring? Is the type of error specified?

Are these domains or subdomains?

do you have a wildcard *.domain.com in your dns records?

night707

1:26 am on May 27, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Do you have a wildcard *.domain.com in your dns records?

No

Are these domains or subdomains?

All 12 domains are old regular domains, no sub domains. 3 of them are several years old with exactly the same dns records since ever.
All were indexed well with a few hundred real content pages, original videos, photos and writing at Google
Is there any more info from Google? Do you know if it is a problem contacting your name servers or with retrieving the relevant records?

Are the DNS errors dated? Are they still occurring? Is the type of error specified?

Google fetch reports for 4/12 : temporarily unreachable but confirms, that server connectivity is given as well as that robots txt are available for all 12/12
DNS errors started in April .

tangor

2:04 am on May 27, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Are all 12 on the same nameserver?

Is there a reason you won't change the nameserver?

night707

5:54 am on May 27, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



As said,. All 12 on the same nameservers since years without any issues until this happened.

robzilla

9:24 am on May 27, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



That's not a reason not to change the nameservers. They might have been corrupted or whatever, it's hard to tell. But if Google has encountered DNS errors since April and it's an ongoing thing, then changing nameservers is the simplest thing you can do that could possibly get your sites re-indexed, so I don't understand why you keep resisting it.

...temporarily unreachable but confirms, that server connectivity...

I asked about DNS errors. That doesn't sound much like a DNS error. More like your website or server configuration is blocking Googlebot for those domains (i.e. can resolve IP, can connect to IP, cannot access website). Post a screenshot of your (DNS) errors in Search Console, if you can.

30K_a_month

11:03 am on May 27, 2016 (gmt 0)

5+ Year Member Top Contributors Of The Month



Switch to cloudflare DNS and test.

Google YOURDOMAIN [SPACE] EXTENSION if you are not 1 or 2 you are deindexed.

night707

6:05 pm on May 27, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Was already testing cloudflare on 2 of the affected domains since this afternoon, thanks.
And both are ok now ....

More like your website or server configuration is blocking Googlebot for those domains


Why for only 4/12 ... All the same settings.
Anyway, cloudflare seems to be a good solution, also improving the speed ...
Thanks a lot guys!

robzilla

8:39 pm on May 27, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I'm glad you caved and solved the problem ;-)

night707

6:41 am on May 28, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



Sorry to report, that joy was premature.

Google fetch can now connect to all 4 affected domains, but still 3 of them report DNS error.

And the one that shows no longer dns error has now robots txt error.

So, not even cloudflare dns seem to get accepted.

robzilla

9:55 am on May 28, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You should probably have another word with your web host, then.

night707

10:45 am on May 28, 2016 (gmt 0)

10+ Year Member Top Contributors Of The Month



In the meantime the 4 sites have at least gone back into the index, google fetch works, so that probably WMT might take another while to fix that for those flagged 3 domains.

Btw. been with that web host since 10 years with various projects. Very reliable and with some outstanding, speedy service and only 1 downtime. Very capable fellows.. .