Are crawling errors creating WMT Content Keyword issues? - Google Search and SEO forum at WebmasterWorld - WebmasterWorld

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Are crawling errors creating WMT Content Keyword issues?

Sibudd

7:03 pm on Feb 23, 2014 (gmt 0)

10+ Year Member

Hi All,

I am stuck on something that I have been looking at for days with no success.

I have a new website built using WordPress. I have submitted the site to Google which worked OK and have submitted a sitemap which has also worked and allowed google to index most of the required pages. However when I select the Google index content keywords on webmaster tools it tells me that the keywords of the site are: -

opens
website
soon
people
store
working

All these words appeared on the holding page for the site which I put up for three months while the site was built. I used a plugin on word press to create the holding page which was therefore showing as the homepage.

When I then look at the crawl errors it seams to suggest that the bots can't connect to the dns server, are having connectivity issues and can't access the robots.txt file even though I know it is there.

I know that the page has only been live for a week but is this all about me playing a waiting game or is there a genuine issue here.

Please help.....

Thanks

Simon

Thanks

phranque

8:57 pm on Feb 23, 2014 (gmt 0)

WebmasterWorld Administrator

10+ Year Member

Top Contributors Of The Month

What does "fetch as googlebot" in GWT tell you?

Sibudd

12:12 am on Feb 24, 2014 (gmt 0)

10+ Year Member

Hi Phranque,

It says the following.....

495 fetches remaining
8URL and linked pages submissions remaining.

It lists 5 different urls that I have submitted with only this one having a fetch status of not found

http://www.example.co.uk/faqs/questions-about-widgets/feed/

which I then resubmitted and it worked.

The other three submissions of http://www.example.co.uk/ have all worked including URL and linked pages submitted to index.

Thanks

Simon
.

[edited by: Robert_Charlton at 1:27 am (utc) on Feb 24, 2014]
[edit reason] exemplified urls - please read forum charter [/edit]

aakk9999

1:34 am on Feb 24, 2014 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

Top Contributors Of The Month

For this last fetch that worked, if you go back to Fetch as Googlebot and then you click on the underlined link of the fetch which says "Sucess", you will get the information on the request response headers and below that the content of the page (starting with something like <!DOCTYPE ....

When you look at that content, do you see the holding page or do you see the proper page you expected to see?

If you see the proper page, then all is fine and you just need to give it a bit of time.

If you see the holding page, then somehow the wrong content is being returned to googlebot.

I suspect that all is probably fine and that you just need to give a bit of time, firstly for Googlebot to catch up, and then subsequently for Google Webmaster Tools to get updated as they are always lagging behind a few days.

Robert Charlton

7:08 am on Feb 24, 2014 (gmt 0)

WebmasterWorld Administrator

10+ Year Member

Top Contributors Of The Month

Sibudd, welcome to WebmasterWorld.

It lists 5 different urls that I have submitted with only this one having a fetch status of not found

http://www.example.co.uk/faqs/questions-about-widgets/feed/

Worth noting that this url (which I'd exemplified, but in essentially the same form as you'd posted) is a feed, and feed urls often are purposely blocked from Google because many webmasters don't want them indexed. That may be the case here. It's possible that one of your WordPress plugins is set up to do that.

As for the rest, I agree that more time is very likely needed. It's probable that Google saw the holding page in the course of three months of construction, perhaps via a url in a public server log, which might explain the prominence of, say...

opens
website
soon...

While I'm not sure what your holding page said, I think I can guess. ;)

You're going to need to drive some traffic to the site, though, to build up some natural inbound links. Keep in mind that Google wants freely given, editorial links. Links in which you control placement or anchor text are very likely to be seen as spam. Much to read here and in our Link Development forum [webmasterworld.com...] about that.