: For Google, the redirection should be OK. 3xx (redirection) Redirects will generally be followed until a valid result can be found (or a loop is recognized). We will follow a limited

@Ogunnowo487

For Google, the redirection should be OK.


3xx (redirection)
Redirects will generally be followed until a valid result can be found (or a loop is recognized). We will follow a limited number of redirect hops (RFC 1945 for HTTP/1.0 allows up to 5 hops) and then stop and treat it as a 404. Handling of robots.txt redirects to disallowed URLs is undefined and discouraged. Handling of logical redirects for the robots.txt file based on HTML content that returns 2xx (frames, JavaScript, or meta refresh-type redirects) is undefined and discouraged.


Source: Robots.txt Specifications

However, if you have already successfully set up an external redirect, can you not change this to an internal rewrite? That way, the search engines won't even know the difference.

Although there is still the niggling thought... if robots.txt is not available directly I would try and resolve this with your CMS!?

Vote Up Vote Down

Login to post a comment!