: What measures can be taken to make sure Google is aware of the existence of a newly created page? Consider a website with a large number of pages. New pages are published regularly. When publishing

@Hamaas447

What you need is to get google trust, then it will work as you expect by default.

One site I've to deal with has 1.5 million indexed pages, PR4 last time i check and a few days ago they run an experiment to check precisely how much time was taking google to publish new content. It turned to be between 5 and 10 minutes.

So, I would focus on get google confidence and trust in your content and authority, if you get that and you produce a lot of content, googlebot will be checking a lot your most changed pages and following the links on them.

That website only actions on publish were:


Link on homepage to new content.
Sitemap update & push to google.

Vote Up Vote Down

@Jessie594

Dynamically updated XML sitemaps submitted through Google Webmaster tools will ensure the content is indexed within a few days.

You could also try 'Fetch as Googlebot' within Google Webmaster tools as this contains a 'submit page to the index' option.

You could also try increasing your crawl rate under webmaster tools if your hosting is slow as this will encourage Googlebot to come back and re-index your site.

If your site has a good reputation and is updated frequently then you will have no problem getting it indexed otherwise after the above three (quicker) options have been tried...you need link building.

Vote Up Vote Down

@Samaraweera270

Here are some steps you can take...


Ping the page to indicate new or updated content. This automatically happens with some CMS systems like WordPress but others may need to run an external script. You only need to do this once for each new content item or for each update. Excessive automated pinging can cause your site to be ignored but don't get paranoid about a few simple manual updates here and there like some do who're being influenced by someone trying to sell a product.
Twitter the link. Post the link on a public Facebook wall. Post the link on a related YouTube video. Similar activity with Google+ may help too but I haven't tested this.
Post the link on other sites, particularly one with authority that has a high crawl rate. Don't be spammy with it though, make it relevant and worthwhile or don't place the link.
Link to the new content from your home page or from another strong page on your site.

Vote Up Vote Down

@Kristi941

As with anything pertaining to Google, getting links to the new pages will help them find and index pages. The rate at which this happens is very much affected by the strength of those links. StackExchange sites, and other large sites like CNN.com, get crawled quickly thanks to having strong links pointing to those pages (internal links do count).

Vote Up Vote Down

@Goswami781

What you need is a sitemap. You can find details about what a sitemap looks like at www.sitemaps.org/. There are various tools available for creating them automatically from your existing site.

However they are only a hint to search engines on how often pages are updated, and do not guarantee that they will index new pages as often as you say they are created or updated.

Vote Up Vote Down