: Google Search Console: 404 errors that aren't linked to I manage an ecommerce website that slightly refreshes its product/category collection every night. Sometimes products/categories get disabled
I manage an ecommerce website that slightly refreshes its product/category collection every night. Sometimes products/categories get disabled and links to them disappear from the website but despite that they get crawled by Google and shown as 404s.
Is it possible that Google crawls website level-by-level and by the time it reaches deeper into links, higher-level pages are updated, some links removed and then it return 404s for these links (that were previously linked on higher levels which were already crawled)?
Is it possible to get rid of these errors?
More posts by @Frith620
1 Comments
Sorted by latest first Latest Oldest Best
If a URL has previously been crawled (and possibly indexed) then Google will continue to crawl that URL for a considerable time after its removal - when it is returning a 404 Not Found. These will naturally appear in the Google Search Console crawl error report. Webmasters make mistakes; a 404 isn't necessarily saying that the page is never coming back.
Google doesn't simply get the list of URLs to crawl from the current crawl of your site, if that is what you are suggesting? AFAIK Google does not necessarily crawl a website "level-by-level".
Alternatively, you can return a 410 Gone for these pages - to send a stronger signal to Google that these pages are truly gone and are never coming back. Google is then more likely to drop the page from its index quicker.
Or, if you have an alternative (ie. very similar / replacement) page to redirect to then redirect instead.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.