Forum Moderators: phranque
does Google use "trial and error"
Has anyone experienced cPanel login pages being indexed by Google? (Possibly a link-only result in the SERPs since they are generally blocked by robots.txt.)
The robots.txt file is not generally accessible at the root url for those ports.
What is needed is for a robots noindex meta tag to be placed on those pages, instead of getting them disallowed in robots.txt.
the only thing that really matters is your response to the request.
It doesn't seem likely that a Ukrainian robot would know something that Google doesn't.
Was this a hypothetical question, or have you been seeing it yourself?
Has anyone experienced cPanel login pages being indexed by Google? (Possibly a link-only result in the SERPs since they are generally blocked by robots.txt.)
The pages return a 401 Access Denied.