: 301 redirect away from content that is served with a reverse proxy to prevent duplicate content I am currently struggling to resolve an issue stemming from a reverse proxy. We are running a

@Heady270

You do not need to move a subdomain to a folder for SEO reasons. Content on subdomains can work great from an SEO perspective. See: Do subdomains help/hurt SEO?

You won't be able to issue 301 redirects from the proxied pages. Your proxy needs those pages up and running to be able to work correctly. You you had page.example.com issue a 301 redirect then your reverse proxy would no longer be able to access the content.

You have several possible solutions:


Implement meta link rel canonical tags. If you put those tags onto the pages served at page.example.com and they pointed to example.com/page then Google would do the right thing. You would be telling Google that there is duplicate content and the preferred URL is the subdirectory. Unlike 301 redirects, the meta tags won't prevent your reverse proxy from operating properly.
Rename the subdomain to something else like xyzzy.example.com and reverse proxy it from there instead. Then the page.example.com would 404 and fall out of the Google index. You might have to deal with the same problem again in the future because Google will eventually find the new subdomain too.
Use robots.txt on the subdomain to prevent Google from crawling it. You would still need to allow the reverse proxy to crawl the subdomain. The pages would eventually mostly fall out of the index. You could implement robots.txt in conjunction with changing the subdomain. Then Googlebot wouldn't index the new subdomain name.
Implement 301 redirects, but only when the content isn't being proxied. Your host would have to put in code that identifies the reverse proxy requests by user agent or other headers. It would serve the content for those requests, but issue 301 redirects otherwise.
Just let the content reside on the subdomain and redirect the subdirectory to it.

Vote Up Vote Down