: Webmaster tools - Network Unreachable webmaster tools for my site displays that robots.txt unreachable and for all links in sitemap it says network unreachable. sitemap.xml unreachable. These appear

Posted in: #GoogleSearchConsole #Sitemap

webmaster tools for my site displays that

robots.txt unreachable
and for all links in sitemap it says network unreachable.
sitemap.xml unreachable.

These appear in crawl stats page.

I discussed with the support team of my hosting and they said...

Hi,

I have verified apache logs, i cannot
see any issues on your
website/webserver/

Possible issues.

There may the routing issue from the googles server to our server.
When a google bots hits goes high the IP will be automatically
blacklisted by our firewall to avoid
server loads & downtimes.

As we donot have access to their
services, We cannot able to give
details of their details/logs etc.

The sitemaps link shows an exclamation mark which means the file was not reachable.

What could be the problem and how to solve it?

10.01% popularity Vote Up Vote Down

: Google analyzing URL We all know Google analyzes URLs in order to get relevance. That's why JavaScriptoptimizer.com hits the first place for the "javascript optimizer" query. These are my questions:

@Chiappetta492

Posted in: #Google #Keywords #Seo #TopLevelDomains #Url

1 Comments

: Do search engines treat index pages with excerpts as duplicate content of the pages they link to? I am using WordPress and in my post sidebar I have related posts which may be of interest

@Chiappetta492

Posted in: #DuplicateContent #Seo #Wordpress

3 Comments

: Drupal is the best all-in-on solution hands down. That said, I'd personally go with simpler tools that are good at a single task, e.g. WordPress for a blog (and/or CMS), Vanilla for forums.

@Chiappetta492

0 Comments

: When will google revert back page rank after i cleared network unrechable error For the past one month i was getting network unreachable error. I contacted my web hosting and they said that

@Chiappetta492

Posted in: #GoogleSearchConsole

2 Comments

Login to post a comment!

1 Comments

Sorted by latest first Latest Oldest Best

@Yeniel560

Try crawl your site using a fake user agent ID matching Googlebot. (e.g. A1 Website Analyzer allows you change user agent ID)

Some website/webserver "protection" systems also test on if e.g. robots.txt get requested, simultaneous connections etc. You can try run some tests to see how agressive your (if any) protection system its.

However, if your server admin himself states they have an anti bot system then... likely that is the reason.

for future you could try add crawl-delay to robots.txt

10% popularity Vote Up Vote Down

Feed

: Webmaster tools - Network Unreachable webmaster tools for my site displays that robots.txt unreachable and for all links in sitemap it says network unreachable. sitemap.xml unreachable. These appear

More posts by @Chiappetta492

: Google analyzing URL We all know Google analyzes URLs in order to get relevance. That's why JavaScriptoptimizer.com hits the first place for the "javascript optimizer" query. These are my questions:

: Do search engines treat index pages with excerpts as duplicate content of the pages they link to? I am using WordPress and in my post sidebar I have related posts which may be of interest

: Drupal is the best all-in-on solution hands down. That said, I'd personally go with simpler tools that are good at a single task, e.g. WordPress for a blog (and/or CMS), Vanilla for forums.

: When will google revert back page rank after i cleared network unrechable error For the past one month i was getting network unreachable error. I contacted my web hosting and they said that

Login to post a comment!

1 Comments

Back to top | Use Dark Theme