: Use robots.txt to prevent privacy policy, terms and conditions, and guarantees from being crawled and indexed by Google I need to block pages such as privacy policy, terms and conditions, and

Posted in: #Html #MetaRobots #Php #RobotsTxt #UrlEncoding

I need to block pages such as privacy policy, terms and conditions, and guarantees from being crawled and indexed by Google. They might be unoriginal. I use them for my multiple websites and they have no content relevant to be ranked by search engines.

Their links are like example.com/privacy.php
I don't want to mess up and end up being penalized by Google

10.01% popularity Vote Up Vote Down

: Why is DKIM signature invalid? I've just set up a new website and had some email addresses set up alongside it. Ran them through mailtester.com and have a spam score of 0.8 /10. I use Wordpress

@Samaraweera270

Posted in: #Dkim #Email #Spam #Spf

0 Comments

: .htaccess and permanent redirection with a special condition I have a WordPress website hosted on Bluehost which contains the following URL pattern: http://www.example.com/2017/01/30/sample-post/ I

@Samaraweera270

Posted in: #301Redirect #Htaccess #ModRewrite #Seo #Wordpress

1 Comments

: Getting too much organic traffic? how to identify is it real or fake? Some days ago I used some traffic generator sites to increase traffic for my site. But after doing log out from this

@Samaraweera270

Posted in: #GoogleAnalytics #Seo

2 Comments

: Could AMP's version of a webpage's URL affect the traffic of the original one? It seems that Google AMP is really important when designing a webpage. Recently I've researched information about

@Samaraweera270

Posted in: #Amp #Domains #Google #Seo

1 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Harper822

Just go to your C panel>>public_html>>site directory and create a file named "robots.txt" in it paste the following code

User-Agent: *
Disallow: /privacy.php/
Disallow: /terms.php/
Allow:
Sitemap: www.xxxxxxx.xxx/sitemap.xml

Change the links above to match up with your site.
With the above, google bots can never crawl any information in the "Disallow" field.

10% popularity Vote Up Vote Down

Feed

: Use robots.txt to prevent privacy policy, terms and conditions, and guarantees from being crawled and indexed by Google I need to block pages such as privacy policy, terms and conditions, and

More posts by @Samaraweera270

: Why is DKIM signature invalid? I've just set up a new website and had some email addresses set up alongside it. Ran them through mailtester.com and have a spam score of 0.8 /10. I use Wordpress

: .htaccess and permanent redirection with a special condition I have a WordPress website hosted on Bluehost which contains the following URL pattern: http://www.example.com/2017/01/30/sample-post/ I

: Getting too much organic traffic? how to identify is it real or fake? Some days ago I used some traffic generator sites to increase traffic for my site. But after doing log out from this

: Could AMP's version of a webpage's URL affect the traffic of the original one? It seems that Google AMP is really important when designing a webpage. Recently I've researched information about

Login to post a comment!

1 Comments

Back to top | Use Dark Theme