: If you redirect to "/" but only allow "/index.php" to be indexed then nothing will be indexed. To you "/" and "/index.php" are the same page. But to the search engines they are two separate

@Pope3001725

If you redirect to "/" but only allow "/index.php" to be indexed then nothing will be indexed. To you "/" and "/index.php" are the same page. But to the search engines they are two separate URLs. By blocking "/", which is the only page users will apparently see, you are blocking your whole website.

If you want to have finer control over what is indexed use the meta tags mentioned above and/or use the x-robots-tag HTTP header to control indexing. Specifically use X-Robots-Tag: noindex on all of your pages except for the index.php. Then there is no need to use the robots.txt file. I read somewhere the HHTP header is more effective and the prefered way to block pages from being indexed but I am unable to find that article at the moment.

Vote Up Vote Down

Login to post a comment!