: Google Webmaster Tools linked from lists dead links How long will Google Webmaster Tools try to crawl old links? We are seeing errors in the crawler that show "linked from" URLs that haven't

@Heady270

Googlebot will never stop crawling a URL if you once had content there. I have 10 year old sites that still get crawled at old URLs.

You have two options:


Return 410 Gone status
Redirect the page to another URL


Google treats the 410 Gone much like 404 and it still shows up in Webmaster Tools as an error, unfortunately.

Vote Up Vote Down

@Pope3001725

There's no set time frame for when Google will stop. But they will eventually stop. They need to keep crawling them for a period of time because those pages may only be unavailable temporarily due to an error on your end. So they want to give them a chance to reappear in those cases.

It is assumed if those pages were intentionally removed you would serve up a 301 redirect to the new URL or a 410 GONE for deleted pages. So in your case you should consider sending 410 GONE statuses for those pages to speed up the process.

Vote Up Vote Down