Mobile app version of vmapp.org
Login or Join
Frith620

: Google Search Console: 404 errors that aren't linked to I manage an ecommerce website that slightly refreshes its product/category collection every night. Sometimes products/categories get disabled

@Frith620

Posted in: #Seo #WebCrawlers

I manage an ecommerce website that slightly refreshes its product/category collection every night. Sometimes products/categories get disabled and links to them disappear from the website but despite that they get crawled by Google and shown as 404s.

Is it possible that Google crawls website level-by-level and by the time it reaches deeper into links, higher-level pages are updated, some links removed and then it return 404s for these links (that were previously linked on higher levels which were already crawled)?

Is it possible to get rid of these errors?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Frith620

1 Comments

Sorted by latest first Latest Oldest Best

 

@Ann8826881

If a URL has previously been crawled (and possibly indexed) then Google will continue to crawl that URL for a considerable time after its removal - when it is returning a 404 Not Found. These will naturally appear in the Google Search Console crawl error report. Webmasters make mistakes; a 404 isn't necessarily saying that the page is never coming back.

Google doesn't simply get the list of URLs to crawl from the current crawl of your site, if that is what you are suggesting? AFAIK Google does not necessarily crawl a website "level-by-level".

Alternatively, you can return a 410 Gone for these pages - to send a stronger signal to Google that these pages are truly gone and are never coming back. Google is then more likely to drop the page from its index quicker.

Or, if you have an alternative (ie. very similar / replacement) page to redirect to then redirect instead.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme