Mobile app version of vmapp.org
Login or Join
Murphy175

: Fix 403 errors in Google Webmaster Tools I have a domain that has "fallen off a cliff" for searches in Google. Searches that used to be in position 1-4 are now gone from page 1. The same

@Murphy175

Posted in: #Google #Seo #Tools

I have a domain that has "fallen off a cliff" for searches in Google. Searches that used to be in position 1-4 are now gone from page 1. The same search in Bing shows the typical position expected (top 5 results).

In reviewing Google Webmaster Tools, I am seeing two problems:
1. The Sitemap is reporting two errors:
General HTTP error: HTTP 403 error (Forbidden)
URLs not accessible

However, the URL they provide as "no accessible" is accessible. I can click the link Google provides and it works fine.


There are 6,000 crawl errors of type 403. Again, most of these pages that have 403 are accessible in my browser (tried various browsers as well). About half are from January, the other half from November.
There are no IP-specific firewall rules on ports 80 and 443 that could block the goolgebot
Using the user agent switcher add-on for FF I confirmed that the page loads when the user agent is the googlebot
I an confirm that most of the pages reported as 403 are accessible.
A search of just "site:thedomain.com" does confirm there are over 9,000 in the index. But most searches don't return the site.


I believe the 403 issues are the cause of the fall in search rankings, but I can't seem to find any information online with ideas about how to address this.

Any ideas?

jpe

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Murphy175

1 Comments

Sorted by latest first Latest Oldest Best

 

@Berumen354

If you're already in Google Webmaster Tools console, try the 'fetch as Googlebot' function to see if that is also returning a 403.

Double-check your robots.txt file, then your page heads for incorrect robots meta, and your server headers for incorrect configuration.

If you find nothing wrong, it could be an issue with Googlebot at a time when there was some network issue. Re-submit the XML sitemap, ping, and wait/review.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme