: Magento Robots.txt and blocking cached images We have a Magento based store. Images are resized and served cached dynamically. When the image cache in Magento is cleared, there are generated new

@Sims2060225

Posted in: #Cache #GoogleSearchConsole #Magento #RobotsTxt

We have a Magento based store.

Images are resized and served cached dynamically.
When the image cache in Magento is cleared, there are generated new paths and files.

And I get 404 errors for them in Webmaster tools / Search Console.

After Googling and looking at examples, I settled on this as a good solution.
(http://inchoo.net/ecommerce/magento-robots-txt-best-practices-google-image-crawler/)

I added this to robots.txt:

User-agent: Googlebot-Image
Disallow:
User-agent: *
Disallow: /media/


The problem now is:

We get a whole lot of "Blocked resources" and "Mobile usability" problems instead.

Google says that it could result in suboptimal rankings: developers.google.com/webmasters/mobile-sites/mobile-seo/common-mistakes/blocked-resources?hl=en
So how does one handle this so Google is happy? What would you recommend?

Vote Up Vote Down

Login to post a comment!