Mobile app version of vmapp.org
Login or Join
Cooney921

: Why doesn't Google remove my noindex and 404 pages? I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at

@Cooney921

Posted in: #Google #GoogleSearchConsole #Indexing #Noindex

I've added 404 error codes and no-index meta tag to pages quite some time ago. However, when I check in Google Webmaster Tools, looking at the graph of "removed" pages from their index, I see very low numbers that don't correspond with the amount of error codes and no-index tags I have on my pages. I can also reach those pages through Google Search.

I've double checked the implementation and it seems fine. Can there be another reason?

10.04% popularity Vote Up Vote Down


Login to follow query

More posts by @Cooney921

3 Comments

Sorted by latest first Latest Oldest Best

 

@Bryan171

The graph you are looking at in Webmaster Tools showing 'removed' I presume that is the index status graph and if so, that shows URLs removed by manual request and not through normal 404 site maintenance.

Look under Crawl > Crawl Errors and you should see recent 404 pages.

10% popularity Vote Up Vote Down


 

@Nimeshi995

Days, Weeks and Months...

It can take Google days, weeks and even months for Google to remove pages marked noindex, robots and 404's. Generally it takes Google several crawls before Google acts on the new information of a page.

User Errors

It should be also noted that more than often users make human errors and create 404's, noindexs and so forth by error, simply removing the pages straight away would cause harm in rankings to such little mistakes, so It's my belief Google does this on purpose to ensure that these are intended changes.

Web Master Tools

Over the years many webmasters have said exactly the same as you over and over, and more times than I can count. Google made changes to Webmaster Tools several years ago allowing webmasters to quickly remove a URL by making a request. If you have a few pages that you want removed straight away then you should make a request, this is by far the quickest method and you should ensure that the pages return noindex if the page exists or a 410 gone to prevent it being re-indexed or denied removal.

410 vs 404

While a 404 is perfectly normal on a small scale it should be noted that 410 is actually preferred, this tells Google the page is GONE FOREVER! while a 404 could be used temporary, or if you have just a few pages that your not fussed about.

10% popularity Vote Up Vote Down


 

@BetL925

If you marked those pages with a noindex meta tag, there are two possible reasons I see:


Googlebot didn't reindex the site yet and you don't have wait enough (it can take a lot of time like several weeks, it depends on the site crawl rate)
You use 404 instead of 410 HTTP status (Gone)

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme