Fetch as Google on a page on my site (let's call it http://example.com)," /> Mobile app version of vmapp.org
Login or Join
Pope3001725

: Webmaster Tools "Fetch as Google" doesn't fetch my js/css/images on a CDN I've discovered that when I do Google Webmaster Tools --> Fetch as Google on a page on my site (let's call it http://example.com),

@Pope3001725

Posted in: #AmazonCloudfront #Cdn #FetchAsGoogle #Googlebot #GoogleSearchConsole

I've discovered that when I do Google Webmaster Tools --> Fetch as Google on a page on my site (let's call it example.com), it shows the static assets (js, css, and images) as Temporarily unreachable.

My static assets are behind an Amazon CloudFront CDN distribution, with the origin being my site, example.com. I have CNAMEd the CloudFront to assets.example.com.

That's exactly what is showing as "Temporarily unreachable" - all the css and js hosted at assets.example.com (for example assets.example.com/assets/application.css). The thing is, I can reach all those files just fine. I fear that googlebot is not seeing the js and css of my site, since when I do a Fetch and Render it says "This is how Googlebot saw the page:" and sure enough it's the page as it would look with no css or js.

I went through the responses on this somewhat similar question, but my CloudFront distribution doesn't even have a robots.txt that could be blocking anything, and the response headers when I do a curl -I on my css & js don't show anything alarming.

What could be causing googlebot to say that my static assets are Temporarily unreachable? Thanks!

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Pope3001725

--> Facebook Fetch as Google on a page on my site (let's call it http://example.com),&url=https://vmapp.org/query/118981/Webmaster-Tools-Fetch-As-Google-Doesn-T-Fetch-My-Js-Css-Images-On-A-CDN-I-Ve-Discovered-That-When-I-Do-Google-Webmaster-Tools-Fetch-As-Google-On-A-Page-On-My-Site-Let-S-Call-It-Http-Example-Com/">Tweet Fetch as Google on a page on my site (let's call it http://example.com),">Reddit Fetch as Google on a page on my site (let's call it http://example.com),&bodytext=">Digg Fetch as Google on a page on my site (let's call it http://example.com),">LinkedIn -->

1 Comments

Sorted by latest first Latest Oldest Best

 

@Pope3001725

Solved it!

My assets.example.com CloudFront distribution needed a robots.txt file after all. After adding one following these instructions, googlebot is able to fetch & render my static assets successfully.

It no longer reports them as Temporarily unreachable, and instead shows Complete.

10% popularity Vote Up Vote Down


--> Facebook Fetch as Google on a page on my site (let's call it http://example.com),&url=https://vmapp.org/query/118981/Webmaster-Tools-Fetch-As-Google-Doesn-T-Fetch-My-Js-Css-Images-On-A-CDN-I-Ve-Discovered-That-When-I-Do-Google-Webmaster-Tools-Fetch-As-Google-On-A-Page-On-My-Site-Let-S-Call-It-Http-Example-Com/">Tweet Fetch as Google on a page on my site (let's call it http://example.com),">Reddit Fetch as Google on a page on my site (let's call it http://example.com),&bodytext=">Digg Fetch as Google on a page on my site (let's call it http://example.com),">LinkedIn -->

Back to top | Use Dark Theme