: How do you tell search engines not to index this page just yet, but maybe in the future? The company I work for has a content management system that builds pages automatically for certain

@BetL925

If the page has no content, your CMS system should not be linking to it. Linking to blank pages is bad for both users and search engines.

I like Wayne Whitty's suggestion about how to put the meta tag on the composer page itself. You should find a way to do something similar in the place where you list all the composers and link to them:

<?php foreach ($composers as $composer) {
if ($composer->countCount > 0)
print "<li><a href="$composer->url">$composer->name</a></li>";
}
} ?>


If you do this, then search engines will no longer find the blank pages to begin with.

Vote Up Vote Down

@Hamm4606531

I would personally build a message into the system that would let the user know that while their request was completed, there were no composers found for the parameters given. This will keep the user from thinking that the page/link is "broken".

Vote Up Vote Down

@Phylliss660

If the "missing" pages indeed contain no actual information, but are simply placeholders for "there may be a page here in the future", then I would recommend configuring your web server to return the 404 Not Found status code for them.

Browsers will still show such pages to the user, just as they show normal 404 error pages (at least as long as they're long enough), but search engines will simply treat the page as if it didn't exist at all.

This is the method used e.g. by Wikipedia for non-existent pages like this one. One of its advantages (besides it being, arguably, semantically correct) is that it guarantees that search engines will treat such pages exactly the same way as they normally treat missing pages that return a 404 status code.

One potential disadvantage is that, if you have links to pages that return a 404 status code, they'll show up as "404 errors" e.g. in Google's Webmaster Tools. However, this is perfectly normal, and not something to worry about.



To further help search engines discover your new pages, when they do get some actual content and stop returning 404s, you should also maintain a regularly updated XML sitemap listing all the pages on your site that do have content. This allows Google and other search engines to discover new pages directly via the site map, instead of having to randomly come across them while recrawling your site.

Ps. See also: Not index page that doesn't have relevant content?

Vote Up Vote Down

@Gloria169

If there is no content for a particular composer, use the meta tag:

<meta name="robots" content="noindex, follow">


As soon as content is added and the meta tag is removed, Google will index it.

Example:

<?php if(empty($composerInfoArray)): ?>
<meta name="robots" content="noindex, follow">
<?php endif; ?>

Vote Up Vote Down