: Google crawler 520 error Google Crawler generates 520 errors daily. I will get about 50-100 of these errors in a 60.000 internal links website. The thing is though, that my links don't have

@LarsenBagley505

I found this article on cloudflare.com that may help:
support.cloudflare.com/hc/en-us/articles/200171936-Error-520-Web-server-is-returning-an-unknown-error
Also, what I'd suggest is to temporarily take your website away from a 3rd party caching service (such as cloudflare) and try running it for a week like that and observe your server logs to see if anything unusual is going on. Also, test it a few times in webpagetest.org to see if the loading times are acceptable.

Also, get a tool that scans every link on your site to make sure they are all valid. I use Xenu Link sleuth (found at home.snafu.de/tilman/xenulink.html#Download).
Once things are acceptable, then try cloudflare again and if you still get HTTP error 520, then there is something wrong with either their service and/or with your account on their service in which case you should contact them directly about the issue.

Vote Up Vote Down