Mobile app version of vmapp.org
Login or Join
Heady270

: Hiding page content from Google when it is duplicated across several sites I would like to hide some content from Google. Because a client has multiple websites with the same content then he

@Heady270

Posted in: #Ajax #DuplicateContent #Google #RobotsTxt

I would like to hide some content from Google.

Because a client has multiple websites with the same content then he gets a warning about duplicate content on some of them (multiple countries, same products same description for the products). I tried loading the content of the page with Ajax after the page has loaded but Google still sees it (hence the warning about duplicate content). Is there a better way to do this with Ajax? Can I run somehow the AJAX that loads the result after the page has loaded in a way that is not executed by Google. I would like to avoid any Black Hat if possible (I fully understand that this can be considered black hat too).

I have also tried converting the text to images, that works decently but the text is not crisp enough even with AA enabled.

I understand the Iframe trick too, but I want to get to it only if AJAX is not possible.

Did anybody try putting functionality in an external JS file, not allowing google bot from indexing it and putting a function that loads AJAX in there externally?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Heady270

1 Comments

Sorted by latest first Latest Oldest Best

 

@Eichhorn148

Not all duplicate content is considered "bad" or "wrong" and not all of it is penalized by search engines. There is an in depth answer about that aspect at: What is duplicate content and how can I avoid being penalized for it on my site?

You mention that one reason that the content is duplicated is because the same products are sold in multiple countries on different websites. This is one area in which Google actually rewards duplicate content. To get the benefits you would need to "geotarget" each site to the country in which it is selling the products. If you own top level country code domains such as example.co.uk, your site will already be targeted to the UK from Google's perspective. If your site is on a generic top level domain such as .com, you will need to register the site in Google Webmaster Tools and set the geo target. If each site is targeted to a different country, then there is no problem with duplicating the contents. You can even have one of the sites as a global site to catch any place that you don't otherwise have a specific site to target.

If you still want to hide some of the content from Google, you can do it with AJAX. Google will not crawl the content if is blocked by robots.txt. So you can load your content into the page with code like $.ajax({url:"/syndicated/content_xyz",success:function(result){... as long as you make sure that robots.txt has this: Disallow: /syndicated

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme