: Stop Googlebot accessing externally cached dynamic CSS/JS files Whilst analysing the server log files using Screaming Frog Log File Analysis I have noticed that Googlebot is accessing dynamic CSS

@Barnes591

Posted in: #Seo #SeoAudit

Whilst analysing the server log files using Screaming Frog Log File Analysis I have noticed that Googlebot is accessing dynamic CSS and JS files that return a HTTP status of 404.

The site is on Wordpress and uses the Automizer plugin.

They purge the cache every time they change the files so I think the non existing CSS and JS files are ones that Googlebot has cached.

Is there anyway to prevent Googlebot from recrawling these files once they 404?
Would it be best to automatically create a 301 redirect when the CSS/JS files change?

Vote Up Vote Down

Login to post a comment!