Forum Moderators: open
Excuse me if this is not the right place to post it but its related to seo that why i posted it here..
i have a question regarding the site for which i m performing seo.. My question is that my client site is hosted on server for eg www.example.com and on the same server other sites designed my the company(my client) is also uploaded until the work is completed.
so its like www.example.com/clients/somesitename in here they upload the clients work to show them how it works.
The problem here is when I checked indexed pages for my seo site its showing everything from the clients folders indexed.
And most of the pages are now being displayed as supplemental results.
I used robots.txt to disallow googlebot from indexing these folders but i m worried about yahoo and msn does they follow the directions in robots.txt
Also what can i do to remove those thousands of supplemental pages from the google yahoo and msn.
The strange thing here is only home page from my site is showing up in google and all other pages are from other folders present on the server..
Please help me
Thank you
www.example.com/clients/somesitename
I've seen this before and it's very bad practice IMO. I'm assuming BTW (from the example given), that this is not a secure (pw protected) server.
A site is about something. Dev work that rests inside a publically accessible folder is not what the site is about.
Moreover, it's visible to anyone who was the luck/wit/wherewithall to get to it. I would not want my competitors peering in on sites that I have in development.
But the competitive aspects aside, work in dev probably has little or nothing at all to do with what the example.com site is about, and only serves to confuse a search engine.
Put all dev work on in protected folders, ideally on protected domains, IMO. We now do not even put our dev work on the Web. We upload and download everything, and view it on our own private servers.
If you must put work like this on a publically accessible domain, create a new domain that exists solely for dev work, so you keep it separate from the company domain.
Once you've moved the work to a new domain or new, protected location, remove all dev work from the main site, and deliver a 410 error message, which will let the SE's know that those pages have been removed.
I will now advice the my client to remove all the worktht is uploaded on the site to new domain and just keep the main site folders on that server..
Will it matter if its gonna take some time as they will slowly remove that to a new domain..
Also i would like to know what is this 410..I have used robots.txt to disallow the folders which are not the part of main site will that help in anyway.
Please advice me how shall i proceed until the things are not removed..
thank you again
