: If you want to block search engines from crawling and/or indexing your pages you can use a few methods: 1) Use robots.txt. Google will honor it and remove those pages automatically although

@Pope3001725

If you want to block search engines from crawling and/or indexing your pages you can use a few methods:

1) Use robots.txt. Google will honor it and remove those pages automatically although there is no timetable for them to get it done

2) Use meta tags

<meta name="robots" content="noindex, nofollow">


3) Use http headers

Header set x-robots-tag: noindex


4) Use rel="nofollow" on any links that point to those pages.

<a href="http://www.example.com/sample.html" rel="nofollow">Link to page I don't want indexed</a>


You can also tell Google to remove those pages from their index in Google Webmaster Tools.

Vote Up Vote Down

Login to post a comment!