: Different robots.txt for two different domains point to same folder I have the following two domains: domain.com test.domain.com Both point to same folder which is "public_html". What

Posted in: #Domains #RobotsTxt #UrlRewriting

I have the following two domains:

domain.com

test.domain.com

Both point to same folder which is "public_html". What I want is a different robots.txt file for each domain. So when someone browse domain.com/robots.txt then a different file is shown. And when someone go to test.domain.com/robots.txt then a different file is shown. How can I do this using URL rewriting in .htacces?

Thanks

10.01% popularity Vote Up Vote Down

: Hidden text in and of itself is fine. It only becomes a problem when you're hiding it for the sake of manipulating the search engines. This usually entails showing different content to your

@Kristi941

0 Comments

: The 301 redirect will tell the search engines that the pages have moved and to associate the old URLs with the new URLs (remember, search engines index and rank pages, not website). This

@Kristi941

0 Comments

: Who says they are stop words or are stripped out by search engines? I know none of the search engines have and I haven't seen anyone offering real evidence that this is the case. Sounds

@Kristi941

0 Comments

: It's easy to use a proxy to mask your true IP address. Additionally ISPs commonly change IP addresses of users during the same session. With the IP6 transition slowly getting started that's

@Kristi941

0 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Frith620

Remeber that no one from internet can see your directory tree, so stackoverflow.com/ and test.stackoverflow.com are completely diffrent sites for us and search robots.
You can do that by checing http host in query.

RewriteCond %{HTTP_HOST} ^test
RewriteRule robots.txt someotherrobots.txt

10% popularity Vote Up Vote Down

Feed

: Different robots.txt for two different domains point to same folder I have the following two domains: domain.com test.domain.com Both point to same folder which is "public_html". What

More posts by @Kristi941

: Hidden text in and of itself is fine. It only becomes a problem when you're hiding it for the sake of manipulating the search engines. This usually entails showing different content to your

: The 301 redirect will tell the search engines that the pages have moved and to associate the old URLs with the new URLs (remember, search engines index and rank pages, not website). This

: Who says they are stop words or are stripped out by search engines? I know none of the search engines have and I haven't seen anyone offering real evidence that this is the case. Sounds

: It's easy to use a proxy to mask your true IP address. Additionally ISPs commonly change IP addresses of users during the same session. With the IP6 transition slowly getting started that's

Login to post a comment!

1 Comments

Back to top | Use Dark Theme