: Google displays search results even after removing URLs in Search Console I am developing an AngualrJS application and since it is not easy to optimize it for search engines, I put it public

@Samaraweera270

You should remove URL in Search console few times and maybe Google will see your request))

Vote Up Vote Down

@BetL925

Google indexes many sites that don't have a search console account. Deleting the property from search console does not effect whether Googlebot will crawl your site and include it in the search index.

If you disallow crawling via robots.txt Googlebot will never be able to see that those pages are 404. Google needs to be able to crawl to see that you have removed the content.

After you have done the temporary removal, allow crawling again to let Googlebot see the 404 errors. Google should crawl all of your pages within a couple weeks. Pages get removed after 24 hours when Googlebot finds a 404 error. If Google can't crawl and see the 404 errors, it may include URLs in the search index indefinitely.

Instead of serving 404 errors just to Googlebot to attempt to get the pages removed, you should tell Google explicitly that you do not want the pages indexed. The way to do that is to include robots meta noindex tags in head section of every page:

<meta name="robots" content="noindex">


Once you put in those tags, you can safely let Googlebot crawl your entire site and non of it will appear in the search engine.

To speed up the no-index process for all the URLs on your site, Google has a Noindex: directive in robots.txt. Change your robots.txt file to:

User-Agent: *
Noindex: /


Even if you do that, you will need to add the noindex meta tags because Google says the Noindex robots.txt is experimental and may go away at any time.

Vote Up Vote Down