: Forcing google to rescan sitemaps instantly When URLs no longer exist on my site, I give a page and issue an HTTP 410 status (the GONE error). I created a script that allows my co-administrator

@Nickens628

Posted in: #410Gone #Error #Google #Googlebot #Sitemap

When URLs no longer exist on my site, I give a page and issue an HTTP 410 status (the GONE error).

I created a script that allows my co-administrator to add and remove pictures from the site and when pictures are removed, that picture page will instead produce an error page and return an HTTP 410 status code to the browser and within approximately five seconds, the sitemaps are updated to reflect the changes.

I also have every page set with the robots noarchive metatag like so:

<meta name="GOOGLEBOT" content="NOARCHIVE">
<meta name="ROBOTS" content="NOARCHIVE">


Everyday when I visit webmaster tools, I get a random number of error URLs all pointing to the photo pages.

Even though google is correct at stating they return 410 status code, URLs still appear in webmaster tools even though the co-adminstrator removed the photo pages through the script and thus all links on the site to the affected URLs as well as all references to the affected URLs from the sitemaps are removed.

I also noticed that the more errors google sees on my site (regardless of whether the status codes are 404 or 410) the less I make in adsense.

I also have configured googlebot to make a max of 10 requests per second (slider all the way to the right).

What can I do to lower the odds of google seeing the newly generated error URLs as a result of removing bad pictures from the site so that I don't see 410 status codes in webmaster tools?

Vote Up Vote Down

Login to post a comment!