Mobile app version of vmapp.org
Login or Join
Murphy175

: 301 and no-index tag don't work Almost 3 months ago I've put no-index tag to about 3,000 pages on my website and 301 redirect (which is permanent redirect) for almost 15,000 pages. (The all

@Murphy175

Posted in: #301Redirect #Googlebot #GoogleIndex

Almost 3 months ago I've put no-index tag to about 3,000 pages on my website and 301 redirect (which is permanent redirect) for almost 15,000 pages. (The all site is about 50,000 pages)

And yet as for today, all of these pages are still appearing in google index.

I've also updated the sitemap.

What can cause it? any advice?



example of no-index page: www.carz.co.il/review/8186
example of 301 redirect page:http://www.carz.co.il/gen/491/overview/2010/

All other pages are exactly the same (same meta tags, HTTP response etc..)

according to Google webmaster tools there are about 4000 pages crawled per day.

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Murphy175

1 Comments

Sorted by latest first Latest Oldest Best

 

@LarsenBagley505

I'm going to have to say google is too slow.

Your best bet is to go into Google search console, access your domain within it, then select the gear icon and then site settings, then for crawl rate, select "Limit Google's maximum crawl rate" and select the biggest crawl value by moving the slider all the way to the right. Then google will make up to 2+ requests per second. If you're lucky it might even allow you to choose 10 requests per second.

When you allow Google to make maximum requests, then it will scan your pages faster and find the no-index tags much faster than before and the waiting time for results will likely be lower.

In either case, I suggest waiting about a day for results. Here's the math that explains it.

3000 ... You applied a no-index tag to 3000 pages.
+15000 ... You applied a 301 redirect to 15000 pages.
------
18000 ... Total modified pages
/ 0.2 ... (divide by google's default scan rate of 0.2 pages per second)
------
72000 ... 72,000 seconds waiting time which is 1,200 minutes or 20 hours.


Now if you crank up the setting to 10 requests per second and google does 10 requests per second, then here's your new math for the waiting time for results:

3000 ... You applied a no-index tag to 3000 pages.
+15000 ... You applied a 301 redirect to 15000 pages.
------
18000 ... Total modified pages
/ 10 ... (10 requests per second)
------
1800 ... 1,800 seconds waiting time which is only 30 minutes.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme