Mobile app version of vmapp.org
Login or Join
Speyer207

: Google Webmaster Tools keeps reporting not finding pages from the old website About 3 months ago we've completely replaced the content of our domain, practically building up a new website. The

@Speyer207

Posted in: #CrawlErrors #GoogleSearchConsole

About 3 months ago we've completely replaced the content of our domain, practically building up a new website. The sitemap for the new website has been submited to Google Webmaster Tools, the website earned very good rankings for a large set of keywords we were looking for.

However, Google Webmaster Tools keeps on returning some "not found" messages, every 2-3 days, but regarding exclusively pages from the old sitemap, the one of the old website, which does not exist anymore.

Why is Google looking to crawl for those old pages, that are not included anymore in the new sitemap and reports not to find them?

10.03% popularity Vote Up Vote Down


Login to follow query

More posts by @Speyer207

3 Comments

Sorted by latest first Latest Oldest Best

 

@Heady270

Once Google crawls a URL, it will continue to try to crawl that URL forever and will never quit complaining about it if it goes away. On one of my sites, we changed the URL structure about 15 years ago. To this day, Googlebot still requests a bunch of the old style URLs, even the ones with no links to them.

You can mitigate this situation by returning something other than a 404 status at these pages


410 Gone -- Google treats it like 404 not found except that it goes in a different report which you can ignore
301 Permanent redirect -- If there is a proper replacement for the pages that you removed on your new site, you should redirect each of the individually. This will work unless you redirect anything to the home page. Google treats redirects to your home page as "soft 404" and they still appear in your 404 report.

10% popularity Vote Up Vote Down


 

@Jamie184

Presumably you are not attempting to redirect these pages because there is no alternative content?

It is possible other sites are still linking to these old URLs, so as Google crawls these other sites and examines the links they are going to generate 404s on your site.

10% popularity Vote Up Vote Down


 

@Murray432

As long as there are links to those pages somewhere, Google will try to crawl it. It takes a long while for Google to be sure a page doesn't exist anymore.

What you can do is 301 redirect those old pages to the new corresponding page. This way Google will know the old page doesn't exist anymore and that it's been replaced. Any "link juice" those pages got from links on other websites will also be transferred after a few months. If you completely rewrote your site and the old pages don't have a corresponding new one, you can just 301 redirect it to the new homepage. This way links on other site will still sort of work and users won't get a 404.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme