: How to exclude certain images on web page from spiders? I have a page with a main image on it that I want to be indexed. I also have a list of other images (thumbnails) on the same web

@Shakeerah822

User-agent: *
Disallow: /wp-content/uploads/*/


Something like this.

Use this code in robots.txt, adding this, you disallow to index the folder /wp-content/uploads/ to all crawlers.

You can found the robots.txt file in your public_html folder.

If this doesn't exist, create it :D

Vote Up Vote Down

@Heady270

Put all your thumbnails into a specific directory that is separated from your main images:


/image/main/
/images/thumb/


Then add a line to your robots.txt file:

Disallow: /images/thumb/

Vote Up Vote Down

@Gonzalez347

What I have found on wiki:

For Yandex:

<!--noindex-->Don't index this text.<!--/noindex-->


For Yahoo:

<div class="robots-nocontent">Don't index this text.</div>


For Google:

<!--googleoff: index--> Don't index this text.<!--googleon: index-->

Vote Up Vote Down