: If you'd like Google to not list certian URLs on your site, add them to robots.txt in the root of your site. Example robots.txt: User-agent: * Disallow: /donotindex/ Note that this is not

@Shakeerah822

If you'd like Google to not list certian URLs on your site, add them to robots.txt in the root of your site.

Example robots.txt:
User-agent: *
Disallow: /donotindex/


Note that this is not secure, you're just "asking" Google to not index/list them. Google will comply with this request. However, sophisticated users and some poorly-behaved crawlers will use or list the URLs regardless.

If you need to hide the content you'll need to put it behind a login page (which crawlers can't use) or change your content based on the client (browser's) user-agent. I believe the latter is specifically disallowed by Google and they may punish your site for doing go.

Vote Up Vote Down

Login to post a comment!