: I tested this using Google Webmaster Tools and can see that it allows GoogleBot access to http://www.example.com and ALSO http://www.example.com/ - However, it denies access to everything else!

@Kevin317

I tested this using Google Webmaster Tools and can see that it allows GoogleBot access to www.example.com and ALSO www.example.com/ - However, it denies access to everything else!

You should create accounts with both Google Webmaster Tools and Bing Webmaster Tools to test out your robots.txt file and check if there are any other problems.

Vote Up Vote Down

Login to post a comment!