: Sudden Increase in "Blocked from robots" In the Index Status section of Google Webmaster Tools a site I manage has seen a sudden increase in pages "Blocked from robots". There's been no spike

Posted in: #GoogleSearchConsole #RobotsTxt

In the Index Status section of Google Webmaster Tools a site I manage has seen a sudden increase in pages "Blocked from robots".

There's been no spike in Crawl Errors since this happened a week and a half ago, so how can I best diagnose this? Is there any way to find a list of the blocked URLs? Is there a reason this spiked suddenly?

10.01% popularity Vote Up Vote Down

: Using for introductory paragraph to a post - a bad idea? I have a news website and on most posts the first paragraph is in bold. Currently the authors are just using <strong> to bold

@Lee4591628

Posted in: #Css #Seo

1 Comments

: Different content, same url, bad for SEO? I want to translate the page based on the accept-language headers, do I need to redirect to /$lang or having different content(actually same content

@Lee4591628

Posted in: #Seo

0 Comments

: 403 Error Fetching Image with JS I've read all the 403-related questions here and elsewhere and I can't find an answer to this question: When I try to get a particular image on a remote domain

@Lee4591628

Posted in: #403Forbidden #Javascript

2 Comments

: Yandex.Webmaster is a service that provides information about the indexing of sites on the Yandex search engine. This service informs Yandex about web pages that appeared or have been deleted.

@Lee4591628

0 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Jamie184

I cannot see any options in Google Webmaster Tools. Unfortunately, Google does not seem to give a clue. At first I thought that the Blocked URLs and testing your robots.txt file would give details, but I am not seeing it. Then I thought perhaps Index Status data could help but no go.

I looked to other tools like Screaming Frog and it is not clear if it will list issues with URLs and the robots.txt file. There is a whole section for the robots.txt file, but I am not sure how deep it will go.

Sorry. This should be a feature in Google Webmaster Tools. Perhaps the test button should list all know URLs that would be blocked.

10% popularity Vote Up Vote Down

Feed

: Sudden Increase in "Blocked from robots" In the Index Status section of Google Webmaster Tools a site I manage has seen a sudden increase in pages "Blocked from robots". There's been no spike

More posts by @Lee4591628

: Using for introductory paragraph to a post - a bad idea? I have a news website and on most posts the first paragraph is in bold. Currently the authors are just using <strong> to bold

: Different content, same url, bad for SEO? I want to translate the page based on the accept-language headers, do I need to redirect to /$lang or having different content(actually same content

: 403 Error Fetching Image with JS I've read all the 403-related questions here and elsewhere and I can't find an answer to this question: When I try to get a particular image on a remote domain

: Yandex.Webmaster is a service that provides information about the indexing of sites on the Yandex search engine. This service informs Yandex about web pages that appeared or have been deleted.

Login to post a comment!

1 Comments

Back to top | Use Dark Theme