: How to prevent Google from finding my admin index page? I am running a website but for some days i stopped it and put the under-construction page because the Index of admin page is visible

@Reiling115

Google and other search engines can easily crawl and index your WordPress theme
files and scripts. It might reduce your page rank and SEO value. To fix this, create or open a robots.txt file in the root of WordPress and add the following code:

User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/themes/
Diasllow: /wp-content/plugins/

Vote Up Vote Down

@Kevin317

There are several ways to block your admin. The easiest way would be to use htaccess to send an HTTP header to tell the search engines not to index any of those pages. Put the following code in an htaccess file in your admin directory:

Header: "X-robots-tag: noindex"


This will apply this header to every page in that directory and subdirectory below it and prevent those pages from being indexed.

You can read more about this in Google's Webmaster Blog.

Vote Up Vote Down

@LarsenBagley505

robots.txt doesn't block Google or others from indexing URLs, it simply asks please do not crawl these URL's while you're here www.mattcutts.com/blog/robots-txt-remove-url/ if these blocked pages are linked to from other pages on the web Google will still index the page, noindex should be used as well as blocking with robots.txt

Vote Up Vote Down

@Ravi8258870

Google webmaster tools allows you to remove pages from their search index for sites that you own.

You can then use robots.txt to ask most major search engines not to index parts of your site Google cover how to create a robots file in some detail and webmaster tools has a useful generator. Example code here

Block a page:-

Disallow: /private_file.html


Block a directory

Disallow: /directory/

Vote Up Vote Down