: Google Webmaster Tools keeps reporting not finding pages from the old website About 3 months ago we've completely replaced the content of our domain, practically building up a new website. The
About 3 months ago we've completely replaced the content of our domain, practically building up a new website. The sitemap for the new website has been submited to Google Webmaster Tools, the website earned very good rankings for a large set of keywords we were looking for.
However, Google Webmaster Tools keeps on returning some "not found" messages, every 2-3 days, but regarding exclusively pages from the old sitemap, the one of the old website, which does not exist anymore.
Why is Google looking to crawl for those old pages, that are not included anymore in the new sitemap and reports not to find them?
More posts by @Speyer207
3 Comments
Sorted by latest first Latest Oldest Best
Once Google crawls a URL, it will continue to try to crawl that URL forever and will never quit complaining about it if it goes away. On one of my sites, we changed the URL structure about 15 years ago. To this day, Googlebot still requests a bunch of the old style URLs, even the ones with no links to them.
You can mitigate this situation by returning something other than a 404 status at these pages
410 Gone -- Google treats it like 404 not found except that it goes in a different report which you can ignore
301 Permanent redirect -- If there is a proper replacement for the pages that you removed on your new site, you should redirect each of the individually. This will work unless you redirect anything to the home page. Google treats redirects to your home page as "soft 404" and they still appear in your 404 report.
Presumably you are not attempting to redirect these pages because there is no alternative content?
It is possible other sites are still linking to these old URLs, so as Google crawls these other sites and examines the links they are going to generate 404s on your site.
As long as there are links to those pages somewhere, Google will try to crawl it. It takes a long while for Google to be sure a page doesn't exist anymore.
What you can do is 301 redirect those old pages to the new corresponding page. This way Google will know the old page doesn't exist anymore and that it's been replaced. Any "link juice" those pages got from links on other websites will also be transferred after a few months. If you completely rewrote your site and the old pages don't have a corresponding new one, you can just 301 redirect it to the new homepage. This way links on other site will still sort of work and users won't get a 404.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.