: How do I find when Googlebot will visit(crawl) my pages again? I implemented the unavailable_after tag in my pages like the below and set to unavailable after 3 days but in Google Webmaster

@BetL925

Googlebot recrawls pages with a frequency based on how popular they are and how often they have changed in the past. CNN's home page gets crawled every few minutes. A PageRank 0 page near the back of an unpopular blog may only get crawled monthly.

As a general rule of thumb, I allow two to three weeks for all the pages on my site to get recrawled when I make changes.

I don't believe that Googlebot actually uses the crawl priority or change date in XML sitemaps to trigger recrawls. The only way that I know to force Google to crawl a page is to use the "Fetch as Google" feature in Webmaster Tools. That tool has a limit of 1000 pages that have to be submitted manually one by one.

See: How to request Google to re-crawl my website?

Vote Up Vote Down